2026-04-29 22:41:57,028 [ 277812 ] INFO : ClickHouse root is not set. Will use /home/ubuntu/_work/ClickHouse/ClickHouse (runner:42, check_args_and_update_paths) 2026-04-29 22:41:57,028 [ 277812 ] INFO : Cases dir is not set. Will use /home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration (runner:86, check_args_and_update_paths) 2026-04-29 22:41:57,028 [ 277812 ] INFO : utils dir is not set. Will use /home/ubuntu/_work/ClickHouse/ClickHouse/utils (runner:97, check_args_and_update_paths) 2026-04-29 22:41:57,028 [ 277812 ] INFO : base_configs_dir: /home/ubuntu/_work/ClickHouse/ClickHouse/programs/server, binary: /home/ubuntu/_work/_temp/test/build/clickhouse, cases_dir: /home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration (runner:99, check_args_and_update_paths) clickhouse_integration_tests_volume Running pytest container as: 'docker run --rm --name clickhouse_integration_tests_vtfnbd --privileged --dns-search='.' --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-odbc-bridge:/clickhouse-odbc-bridge --volume=/home/ubuntu/_work/_temp/test/build/clickhouse:/clickhouse --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-library-bridge:/clickhouse-library-bridge --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/programs/server:/clickhouse-config --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration:/ClickHouse/tests/integration --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/backupview:/ClickHouse/utils/backupview --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/grpc-client/pb2:/ClickHouse/utils/grpc-client/pb2 --volume=/run:/run/host:ro --volume=clickhouse_integration_tests_volume:/var/lib/docker -e DOCKER_DOTNET_CLIENT_TAG=11de0b29a15d -e DOCKER_HELPER_TAG=2cffe1eae894 -e DOCKER_BASE_TAG=1e0b53d756cf -e DOCKER_KERBEROS_KDC_TAG=9391ecdee8d7 -e DOCKER_MYSQL_GOLANG_CLIENT_TAG=9bec2a638e6e -e DOCKER_MYSQL_JAVA_CLIENT_TAG=766bff31cfe4 -e DOCKER_MYSQL_JS_CLIENT_TAG=41ba7c2ec2a1 -e DOCKER_MYSQL_PHP_CLIENT_TAG=88be89c1e3b6 -e DOCKER_NGINX_DAV_TAG=b55ac9cd7519 -e DOCKER_POSTGRESQL_JAVA_CLIENT_TAG=a4eff5c7f4d6 -e DOCKER_PYTHON_BOTTLE_TAG=caad4729259e -e DOCKER_CLIENT_TIMEOUT=300 -e COMPOSE_HTTP_TIMEOUT=600 -e PYTHONUNBUFFERED=1 -e PYTEST_ADDOPTS="--dist=loadfile -n 10 -rfEps --run-id=0 --color=no --durations=0 test_grpc_protocol/test.py::test_output_format test_grpc_protocol/test.py::test_progress test_grpc_protocol/test.py::test_restart test_grpc_protocol/test.py::test_select_one test_grpc_protocol/test.py::test_session_settings test_grpc_protocol/test.py::test_session_temp_tables test_grpc_protocol/test.py::test_simultaneous_queries_multiple_channels test_grpc_protocol/test.py::test_simultaneous_queries_same_channel test_grpc_protocol/test.py::test_totals_and_extremes test_grpc_protocol/test.py::test_transport_compression test_https_s3_table_function_with_http_proxy_no_tunneling/test.py::test_s3_with_https_env_proxy test_https_s3_table_function_with_http_proxy_no_tunneling/test.py::test_s3_with_https_proxy_list test_https_s3_table_function_with_http_proxy_no_tunneling/test.py::test_s3_with_https_remote_proxy test_insert_into_distributed/test.py::test_inserts_local test_insert_into_distributed/test.py::test_inserts_low_cardinality test_insert_into_distributed/test.py::test_inserts_single_replica_internal_replication test_insert_into_distributed/test.py::test_inserts_single_replica_local_internal_replication test_insert_into_distributed/test.py::test_inserts_single_replica_no_internal_replication test_insert_into_distributed/test.py::test_prefer_localhost_replica test_insert_into_distributed/test.py::test_table_function test_insert_into_distributed_sync_async/test.py::test_async_inserts_into_local_shard test_insert_into_distributed_sync_async/test.py::test_insertion_sync test_insert_into_distributed_sync_async/test.py::test_insertion_sync_fails_with_timeout test_insert_into_distributed_sync_async/test.py::test_insertion_sync_with_disabled_timeout test_insert_into_distributed_sync_async/test.py::test_insertion_without_sync_ignores_timeout test_intersecting_parts/test.py::test_intersect_parts_when_restart test_interserver_dns_retires/test.py::test_query test_jdbc_bridge/test.py::test_jdbc_delete test_jdbc_bridge/test.py::test_jdbc_distributed_query test_jdbc_bridge/test.py::test_jdbc_insert test_jdbc_bridge/test.py::test_jdbc_query test_jdbc_bridge/test.py::test_jdbc_table_engine test_jdbc_bridge/test.py::test_jdbc_update test_join_set_family_s3/test.py::test_join_s3 test_join_set_family_s3/test.py::test_set_s3 test_kafka_bad_messages/test.py::test_bad_messages_parsing_exception test_kafka_bad_messages/test.py::test_bad_messages_parsing_stream test_kafka_bad_messages/test.py::test_bad_messages_to_mv test_keeper_back_to_back/test.py::test_concurrent_watches test_keeper_back_to_back/test.py::test_end_of_session test_keeper_back_to_back/test.py::test_end_of_watches_session test_keeper_back_to_back/test.py::test_multitransactions test_keeper_back_to_back/test.py::test_random_requests test_keeper_back_to_back/test.py::test_sequential_nodes test_keeper_back_to_back/test.py::test_simple_commands test_keeper_back_to_back/test.py::test_stats test_keeper_back_to_back/test.py::test_watchers test_keeper_broken_logs/test.py::test_single_node_broken_log test_keeper_client/test.py::test_base_commands test_keeper_client/test.py::test_big_family test_keeper_client/test.py::test_delete_stale_backups test_keeper_client/test.py::test_find_super_nodes test_keeper_client/test.py::test_four_letter_word_commands test_keeper_client/test.py::test_get_all_children_number test_keeper_client/test.py::test_quoted_argument_parsing test_keeper_client/test.py::test_rm_with_version test_keeper_client/test.py::test_rm_without_version test_keeper_client/test.py::test_set_with_version test_keeper_client/test.py::test_set_without_version test_keeper_memory_soft_limit/test.py::test_soft_limit_create test_keeper_multinode_simple/test.py::test_follower_restart test_keeper_multinode_simple/test.py::test_read_write_multinode test_keeper_multinode_simple/test.py::test_simple_replicated_table test_keeper_multinode_simple/test.py::test_watch_on_follower test_keeper_nodes_add/test.py::test_nodes_add test_keeper_persistent_log_multinode/test.py::test_restart_multinode test_keeper_reconfig_remove/test.py::test_reconfig_remove_followers_from_3 test_keeper_reconfig_remove_many/test.py::test_reconfig_remove_2_and_leader test_keeper_reconfig_replace_leader_in_one_command/test.py::test_reconfig_replace_leader_in_one_command test_keeper_restore_from_snapshot/test.py::test_recover_from_snapshot test_keeper_snapshot_on_exit/test.py::test_snapshot_on_exit test_keeper_three_nodes_start/test.py::test_smoke 'test_lazy_database/test.py::test_drop_table[0-default-False-Log]' 'test_lazy_database/test.py::test_drop_table[0-s3-True-Log]' 'test_lazy_database/test.py::test_drop_table[4-default-False-Log]' 'test_lazy_database/test.py::test_drop_table[4-s3-True-Log]' test_ldap_external_user_directory/test.py::test_authentication_fail test_ldap_external_user_directory/test.py::test_authentication_pass test_ldap_external_user_directory/test.py::test_push_role_to_other_nodes test_ldap_external_user_directory/test.py::test_remote_query_user_does_not_exist_locally test_ldap_external_user_directory/test.py::test_role_mapping test_log_levels_update/test.py::test_log_levels_update test_logs_level/test.py::test_check_client_logs_level test_lost_part_during_startup/test.py::test_lost_part_during_startup test_mask_sensitive_info/test.py::test_backup_table test_mask_sensitive_info/test.py::test_backup_to_s3 test_mask_sensitive_info/test.py::test_create_alter_user test_mask_sensitive_info/test.py::test_create_database test_mask_sensitive_info/test.py::test_create_dictionary test_mask_sensitive_info/test.py::test_create_table test_mask_sensitive_info/test.py::test_encryption_functions test_mask_sensitive_info/test.py::test_on_cluster test_mask_sensitive_info/test.py::test_table_function_ways_to_call test_mask_sensitive_info/test.py::test_table_functions test_materialized_mysql_database/test.py::test_binlog_client test_materialized_mysql_database/test.py::test_clickhouse_killed_while_insert_5_7 test_materialized_mysql_database/test.py::test_clickhouse_killed_while_insert_8_0 test_materialized_mysql_database/test.py::test_create_database_without_mysql_connection test_materialized_mysql_database/test.py::test_create_table_as_select test_materialized_mysql_database/test.py::test_default_values -vvv" altinityinfra/integration-tests-runner:37a9815fd2fa '. Start tests ============================= test session starts ============================== platform linux -- Python 3.10.12, pytest-7.4.4, pluggy-1.5.0 -- /usr/bin/python3 cachedir: .pytest_cache rootdir: /ClickHouse/tests/integration configfile: pytest.ini plugins: order-1.0.1, random-0.2, timeout-2.2.0, repeat-0.9.3, reportlog-0.4.0, xdist-3.5.0 timeout: 900.0s timeout method: signal timeout func_only: False created: 10/10 workers 10 workers [100 items] scheduling tests via LoadFileScheduling test_keeper_client/test.py::test_base_commands test_grpc_protocol/test.py::test_output_format test_keeper_back_to_back/test.py::test_concurrent_watches test_insert_into_distributed_sync_async/test.py::test_async_inserts_into_local_shard test_materialized_mysql_database/test.py::test_binlog_client test_mask_sensitive_info/test.py::test_backup_table test_keeper_multinode_simple/test.py::test_follower_restart test_ldap_external_user_directory/test.py::test_authentication_fail test_insert_into_distributed/test.py::test_inserts_local test_jdbc_bridge/test.py::test_jdbc_delete [gw1] [ 1%] PASSED test_grpc_protocol/test.py::test_output_format test_grpc_protocol/test.py::test_progress [gw8] [ 2%] PASSED test_insert_into_distributed_sync_async/test.py::test_async_inserts_into_local_shard test_insert_into_distributed_sync_async/test.py::test_insertion_sync [gw1] [ 3%] PASSED test_grpc_protocol/test.py::test_progress test_grpc_protocol/test.py::test_restart [gw8] [ 4%] PASSED test_insert_into_distributed_sync_async/test.py::test_insertion_sync test_insert_into_distributed_sync_async/test.py::test_insertion_sync_fails_with_timeout [gw9] [ 5%] PASSED test_keeper_multinode_simple/test.py::test_follower_restart test_keeper_multinode_simple/test.py::test_read_write_multinode [gw0] [ 6%] PASSED test_keeper_client/test.py::test_base_commands test_keeper_client/test.py::test_big_family [gw0] [ 7%] PASSED test_keeper_client/test.py::test_big_family test_keeper_client/test.py::test_delete_stale_backups [gw9] [ 8%] PASSED test_keeper_multinode_simple/test.py::test_read_write_multinode test_keeper_multinode_simple/test.py::test_simple_replicated_table [gw0] [ 9%] PASSED test_keeper_client/test.py::test_delete_stale_backups test_keeper_client/test.py::test_find_super_nodes [gw8] [ 10%] PASSED test_insert_into_distributed_sync_async/test.py::test_insertion_sync_fails_with_timeout test_insert_into_distributed_sync_async/test.py::test_insertion_sync_with_disabled_timeout [gw0] [ 11%] PASSED test_keeper_client/test.py::test_find_super_nodes test_keeper_client/test.py::test_four_letter_word_commands [gw0] [ 12%] PASSED test_keeper_client/test.py::test_four_letter_word_commands test_keeper_client/test.py::test_get_all_children_number [gw0] [ 13%] PASSED test_keeper_client/test.py::test_get_all_children_number test_keeper_client/test.py::test_quoted_argument_parsing [gw0] [ 14%] PASSED test_keeper_client/test.py::test_quoted_argument_parsing test_keeper_client/test.py::test_rm_with_version [gw0] [ 15%] PASSED test_keeper_client/test.py::test_rm_with_version test_keeper_client/test.py::test_rm_without_version [gw0] [ 16%] PASSED test_keeper_client/test.py::test_rm_without_version test_keeper_client/test.py::test_set_with_version [gw0] [ 17%] PASSED test_keeper_client/test.py::test_set_with_version test_keeper_client/test.py::test_set_without_version [gw8] [ 18%] PASSED test_insert_into_distributed_sync_async/test.py::test_insertion_sync_with_disabled_timeout test_insert_into_distributed_sync_async/test.py::test_insertion_without_sync_ignores_timeout [gw0] [ 19%] PASSED test_keeper_client/test.py::test_set_without_version [gw9] [ 20%] PASSED test_keeper_multinode_simple/test.py::test_simple_replicated_table test_keeper_multinode_simple/test.py::test_watch_on_follower [gw8] [ 21%] PASSED test_insert_into_distributed_sync_async/test.py::test_insertion_without_sync_ignores_timeout [gw1] [ 22%] PASSED test_grpc_protocol/test.py::test_restart test_grpc_protocol/test.py::test_select_one [gw1] [ 23%] PASSED test_grpc_protocol/test.py::test_select_one test_grpc_protocol/test.py::test_session_settings [gw1] [ 24%] PASSED test_grpc_protocol/test.py::test_session_settings test_grpc_protocol/test.py::test_session_temp_tables [gw1] [ 25%] PASSED test_grpc_protocol/test.py::test_session_temp_tables test_grpc_protocol/test.py::test_simultaneous_queries_multiple_channels [gw9] [ 26%] PASSED test_keeper_multinode_simple/test.py::test_watch_on_follower [gw1] [ 27%] PASSED test_grpc_protocol/test.py::test_simultaneous_queries_multiple_channels test_grpc_protocol/test.py::test_simultaneous_queries_same_channel [gw6] [ 28%] PASSED test_jdbc_bridge/test.py::test_jdbc_delete test_jdbc_bridge/test.py::test_jdbc_distributed_query [gw6] [ 29%] PASSED test_jdbc_bridge/test.py::test_jdbc_distributed_query test_jdbc_bridge/test.py::test_jdbc_insert [gw1] [ 30%] PASSED test_grpc_protocol/test.py::test_simultaneous_queries_same_channel test_grpc_protocol/test.py::test_totals_and_extremes test_kafka_bad_messages/test.py::test_bad_messages_parsing_exception [gw1] [ 31%] PASSED test_grpc_protocol/test.py::test_totals_and_extremes [gw6] [ 32%] PASSED test_jdbc_bridge/test.py::test_jdbc_insert test_jdbc_bridge/test.py::test_jdbc_query test_grpc_protocol/test.py::test_transport_compression [gw1] [ 33%] PASSED test_grpc_protocol/test.py::test_transport_compression [gw6] [ 34%] PASSED test_jdbc_bridge/test.py::test_jdbc_query test_jdbc_bridge/test.py::test_jdbc_table_engine [gw6] [ 35%] PASSED test_jdbc_bridge/test.py::test_jdbc_table_engine test_jdbc_bridge/test.py::test_jdbc_update [gw6] [ 36%] PASSED test_jdbc_bridge/test.py::test_jdbc_update test_https_s3_table_function_with_http_proxy_no_tunneling/test.py::test_s3_with_https_env_proxy test_lazy_database/test.py::test_drop_table[0-default-False-Log] test_join_set_family_s3/test.py::test_join_s3 [gw2] [ 37%] PASSED test_mask_sensitive_info/test.py::test_backup_table test_mask_sensitive_info/test.py::test_backup_to_s3 [gw2] [ 38%] PASSED test_mask_sensitive_info/test.py::test_backup_to_s3 test_mask_sensitive_info/test.py::test_create_alter_user [gw2] [ 39%] PASSED test_mask_sensitive_info/test.py::test_create_alter_user test_mask_sensitive_info/test.py::test_create_database [gw2] [ 40%] PASSED test_mask_sensitive_info/test.py::test_create_database test_mask_sensitive_info/test.py::test_create_dictionary [gw2] [ 41%] PASSED test_mask_sensitive_info/test.py::test_create_dictionary test_mask_sensitive_info/test.py::test_create_table [gw4] [ 42%] PASSED test_keeper_back_to_back/test.py::test_concurrent_watches test_keeper_back_to_back/test.py::test_end_of_session [gw4] [ 43%] PASSED test_keeper_back_to_back/test.py::test_end_of_session test_keeper_back_to_back/test.py::test_end_of_watches_session test_intersecting_parts/test.py::test_intersect_parts_when_restart [gw4] [ 44%] PASSED test_keeper_back_to_back/test.py::test_end_of_watches_session test_keeper_back_to_back/test.py::test_multitransactions [gw4] [ 45%] PASSED test_keeper_back_to_back/test.py::test_multitransactions test_keeper_back_to_back/test.py::test_random_requests [gw7] [ 46%] PASSED test_ldap_external_user_directory/test.py::test_authentication_fail test_ldap_external_user_directory/test.py::test_authentication_pass [gw7] [ 47%] PASSED test_ldap_external_user_directory/test.py::test_authentication_pass test_ldap_external_user_directory/test.py::test_push_role_to_other_nodes [gw7] [ 48%] PASSED test_ldap_external_user_directory/test.py::test_push_role_to_other_nodes test_ldap_external_user_directory/test.py::test_remote_query_user_does_not_exist_locally [gw7] [ 49%] PASSED test_ldap_external_user_directory/test.py::test_remote_query_user_does_not_exist_locally test_ldap_external_user_directory/test.py::test_role_mapping [gw7] [ 50%] PASSED test_ldap_external_user_directory/test.py::test_role_mapping [gw2] [ 51%] PASSED test_mask_sensitive_info/test.py::test_create_table test_mask_sensitive_info/test.py::test_encryption_functions test_keeper_nodes_add/test.py::test_nodes_add [gw9] [ 52%] PASSED test_lazy_database/test.py::test_drop_table[0-default-False-Log] test_lazy_database/test.py::test_drop_table[0-s3-True-Log] [gw9] [ 53%] PASSED test_lazy_database/test.py::test_drop_table[0-s3-True-Log] test_lazy_database/test.py::test_drop_table[4-default-False-Log] [gw2] [ 54%] PASSED test_mask_sensitive_info/test.py::test_encryption_functions test_mask_sensitive_info/test.py::test_on_cluster [gw2] [ 55%] PASSED test_mask_sensitive_info/test.py::test_on_cluster test_mask_sensitive_info/test.py::test_table_function_ways_to_call [gw9] [ 56%] PASSED test_lazy_database/test.py::test_drop_table[4-default-False-Log] test_lazy_database/test.py::test_drop_table[4-s3-True-Log] [gw2] [ 57%] PASSED test_mask_sensitive_info/test.py::test_table_function_ways_to_call test_mask_sensitive_info/test.py::test_table_functions [gw1] [ 58%] PASSED test_join_set_family_s3/test.py::test_join_s3 test_join_set_family_s3/test.py::test_set_s3 [gw9] [ 59%] PASSED test_lazy_database/test.py::test_drop_table[4-s3-True-Log] [gw1] [ 60%] PASSED test_join_set_family_s3/test.py::test_set_s3 [gw3] [ 61%] PASSED test_insert_into_distributed/test.py::test_inserts_local test_insert_into_distributed/test.py::test_inserts_low_cardinality [gw3] [ 62%] PASSED test_insert_into_distributed/test.py::test_inserts_low_cardinality test_insert_into_distributed/test.py::test_inserts_single_replica_internal_replication [gw3] [ 63%] PASSED test_insert_into_distributed/test.py::test_inserts_single_replica_internal_replication test_insert_into_distributed/test.py::test_inserts_single_replica_local_internal_replication [gw3] [ 64%] PASSED test_insert_into_distributed/test.py::test_inserts_single_replica_local_internal_replication test_insert_into_distributed/test.py::test_inserts_single_replica_no_internal_replication [gw3] [ 65%] PASSED test_insert_into_distributed/test.py::test_inserts_single_replica_no_internal_replication test_insert_into_distributed/test.py::test_prefer_localhost_replica [gw6] [ 66%] PASSED test_intersecting_parts/test.py::test_intersect_parts_when_restart [gw3] [ 67%] PASSED test_insert_into_distributed/test.py::test_prefer_localhost_replica test_insert_into_distributed/test.py::test_table_function [gw3] [ 68%] PASSED test_insert_into_distributed/test.py::test_table_function test_keeper_reconfig_remove_many/test.py::test_reconfig_remove_2_and_leader test_interserver_dns_retires/test.py::test_query test_keeper_broken_logs/test.py::test_single_node_broken_log test_log_levels_update/test.py::test_log_levels_update [gw8] [ 69%] PASSED test_https_s3_table_function_with_http_proxy_no_tunneling/test.py::test_s3_with_https_env_proxy test_https_s3_table_function_with_http_proxy_no_tunneling/test.py::test_s3_with_https_proxy_list [gw8] [ 70%] PASSED test_https_s3_table_function_with_http_proxy_no_tunneling/test.py::test_s3_with_https_proxy_list test_https_s3_table_function_with_http_proxy_no_tunneling/test.py::test_s3_with_https_remote_proxy [gw2] [ 71%] PASSED test_mask_sensitive_info/test.py::test_table_functions [gw8] [ 72%] PASSED test_https_s3_table_function_with_http_proxy_no_tunneling/test.py::test_s3_with_https_remote_proxy test_keeper_reconfig_replace_leader_in_one_command/test.py::test_reconfig_replace_leader_in_one_command [gw7] [ 73%] PASSED test_keeper_nodes_add/test.py::test_nodes_add test_keeper_persistent_log_multinode/test.py::test_restart_multinode [gw3] [ 74%] PASSED test_log_levels_update/test.py::test_log_levels_update [gw6] [ 75%] PASSED test_interserver_dns_retires/test.py::test_query test_keeper_memory_soft_limit/test.py::test_soft_limit_create test_logs_level/test.py::test_check_client_logs_level [gw1] [ 76%] PASSED test_keeper_broken_logs/test.py::test_single_node_broken_log [gw9] [ 77%] PASSED test_keeper_reconfig_remove_many/test.py::test_reconfig_remove_2_and_leader [gw4] [ 78%] PASSED test_keeper_back_to_back/test.py::test_random_requests test_keeper_back_to_back/test.py::test_sequential_nodes test_keeper_three_nodes_start/test.py::test_smoke [gw4] [ 79%] PASSED test_keeper_back_to_back/test.py::test_sequential_nodes test_keeper_back_to_back/test.py::test_simple_commands [gw4] [ 80%] PASSED test_keeper_back_to_back/test.py::test_simple_commands test_keeper_back_to_back/test.py::test_stats [gw4] [ 81%] PASSED test_keeper_back_to_back/test.py::test_stats test_keeper_back_to_back/test.py::test_watchers test_keeper_restore_from_snapshot/test.py::test_recover_from_snapshot [gw4] [ 82%] PASSED test_keeper_back_to_back/test.py::test_watchers [gw0] [ 83%] PASSED test_kafka_bad_messages/test.py::test_bad_messages_parsing_exception test_kafka_bad_messages/test.py::test_bad_messages_parsing_stream [gw3] [ 84%] PASSED test_logs_level/test.py::test_check_client_logs_level [gw7] [ 85%] PASSED test_keeper_persistent_log_multinode/test.py::test_restart_multinode test_keeper_reconfig_remove/test.py::test_reconfig_remove_followers_from_3 [gw2] [ 86%] PASSED test_keeper_reconfig_replace_leader_in_one_command/test.py::test_reconfig_replace_leader_in_one_command [gw1] [ 87%] PASSED test_keeper_three_nodes_start/test.py::test_smoke test_keeper_snapshot_on_exit/test.py::test_snapshot_on_exit [gw9] [ 88%] FAILED test_keeper_restore_from_snapshot/test.py::test_recover_from_snapshot test_lost_part_during_startup/test.py::test_lost_part_during_startup [gw5] [ 89%] PASSED test_materialized_mysql_database/test.py::test_binlog_client test_materialized_mysql_database/test.py::test_clickhouse_killed_while_insert_5_7 [gw7] [ 90%] PASSED test_keeper_reconfig_remove/test.py::test_reconfig_remove_followers_from_3 [gw5] [ 91%] PASSED test_materialized_mysql_database/test.py::test_clickhouse_killed_while_insert_5_7 test_materialized_mysql_database/test.py::test_clickhouse_killed_while_insert_8_0 [gw5] [ 92%] PASSED test_materialized_mysql_database/test.py::test_clickhouse_killed_while_insert_8_0 test_materialized_mysql_database/test.py::test_create_database_without_mysql_connection [gw2] [ 93%] PASSED test_keeper_snapshot_on_exit/test.py::test_snapshot_on_exit [gw5] [ 94%] PASSED test_materialized_mysql_database/test.py::test_create_database_without_mysql_connection test_materialized_mysql_database/test.py::test_create_table_as_select [gw5] [ 95%] PASSED test_materialized_mysql_database/test.py::test_create_table_as_select test_materialized_mysql_database/test.py::test_default_values [gw5] [ 96%] PASSED test_materialized_mysql_database/test.py::test_default_values [gw6] [ 97%] PASSED test_keeper_memory_soft_limit/test.py::test_soft_limit_create [gw0] [ 98%] PASSED test_kafka_bad_messages/test.py::test_bad_messages_parsing_stream test_kafka_bad_messages/test.py::test_bad_messages_to_mv [gw0] [ 99%] PASSED test_kafka_bad_messages/test.py::test_bad_messages_to_mv [gw9] [100%] PASSED test_lost_part_during_startup/test.py::test_lost_part_during_startup =================================== FAILURES =================================== __________________________ test_recover_from_snapshot __________________________ [gw9] linux -- Python 3.10.12 /usr/bin/python3 started_cluster = def test_recover_from_snapshot(started_cluster): try: node1_zk = node2_zk = node3_zk = None node1_zk = get_fake_zk("node1") node2_zk = get_fake_zk("node2") node3_zk = get_fake_zk("node3") node1_zk.create("/test_snapshot_multinode_recover", "somedata".encode()) node2_zk.sync("/test_snapshot_multinode_recover") node3_zk.sync("/test_snapshot_multinode_recover") assert node1_zk.get("/test_snapshot_multinode_recover")[0] == b"somedata" assert node2_zk.get("/test_snapshot_multinode_recover")[0] == b"somedata" assert node3_zk.get("/test_snapshot_multinode_recover")[0] == b"somedata" node3.stop_clickhouse(kill=True) # at least we will have 2 snapshots for i in range(435): node1_zk.create( "/test_snapshot_multinode_recover" + str(i), ("somedata" + str(i)).encode(), ) for i in range(435): if i % 10 == 0: node1_zk.delete("/test_snapshot_multinode_recover" + str(i)) finally: for zk in [node1_zk, node2_zk, node3_zk]: stop_zk(zk) # stale node should recover from leader's snapshot # with some sanitizers can start longer than 5 seconds node3.start_clickhouse(20) keeper_utils.wait_until_connected(cluster, node3) print("Restarted") try: node1_zk = node2_zk = node3_zk = None node1_zk = get_fake_zk("node1") node2_zk = get_fake_zk("node2") node3_zk = get_fake_zk("node3") node1_zk.sync("/test_snapshot_multinode_recover") node2_zk.sync("/test_snapshot_multinode_recover") node3_zk.sync("/test_snapshot_multinode_recover") assert node1_zk.get("/test_snapshot_multinode_recover")[0] == b"somedata" assert node2_zk.get("/test_snapshot_multinode_recover")[0] == b"somedata" assert node3_zk.get("/test_snapshot_multinode_recover")[0] == b"somedata" for i in range(435): if i % 10 != 0: assert ( node1_zk.get("/test_snapshot_multinode_recover" + str(i))[0] == ("somedata" + str(i)).encode() ) assert ( node2_zk.get("/test_snapshot_multinode_recover" + str(i))[0] == ("somedata" + str(i)).encode() > ) test_keeper_restore_from_snapshot/test.py:120: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ /usr/local/lib/python3.10/dist-packages/kazoo/client.py:1165: in get return self.get_async(path, watch=watch).get() _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ self = block = True, timeout = None def get(self, block=True, timeout=None): """Return the stored value or raise the exception. If there is no value raises TimeoutError. """ with self._condition: if self._exception is not _NONE: if self._exception is None: return self.value raise self._exception elif block: self._condition.wait(timeout) if self._exception is not _NONE: if self._exception is None: return self.value > raise self._exception E kazoo.exceptions.ConnectionLoss /usr/local/lib/python3.10/dist-packages/kazoo/handlers/utils.py:86: ConnectionLoss ---------------------------- Captured stdout setup ----------------------------- Copy common default production configuration from /clickhouse-config. Files: config.xml, users.xml Copy common default production configuration from /clickhouse-config. Files: config.xml, users.xml Copy common default production configuration from /clickhouse-config. Files: config.xml, users.xml ------------------------------ Captured log setup ------------------------------ 2026-04-29 22:46:38 [ 539 ] INFO : Running tests in /ClickHouse/tests/integration/test_keeper_restore_from_snapshot/test.py (cluster.py:2788, start) 2026-04-29 22:46:38 [ 539 ] DEBUG : Cluster start called. is_up=False (cluster.py:2795, start) 2026-04-29 22:46:38 [ 539 ] DEBUG : Docker networks for project roottestkeeperrestorefromsnapshot_gw9 are NETWORK ID NAME DRIVER SCOPE (cluster.py:855, print_all_docker_pieces) 2026-04-29 22:46:38 [ 539 ] DEBUG : Docker containers for project roottestkeeperrestorefromsnapshot_gw9 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:863, print_all_docker_pieces) 2026-04-29 22:46:39 [ 539 ] DEBUG : Docker volumes for project roottestkeeperrestorefromsnapshot_gw9 are DRIVER VOLUME NAME (cluster.py:871, print_all_docker_pieces) 2026-04-29 22:46:39 [ 539 ] DEBUG : Cleanup called (cluster.py:876, cleanup) 2026-04-29 22:46:39 [ 539 ] DEBUG : Docker networks for project roottestkeeperrestorefromsnapshot_gw9 are NETWORK ID NAME DRIVER SCOPE (cluster.py:855, print_all_docker_pieces) 2026-04-29 22:46:39 [ 539 ] DEBUG : Docker containers for project roottestkeeperrestorefromsnapshot_gw9 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:863, print_all_docker_pieces) 2026-04-29 22:46:39 [ 539 ] DEBUG : Docker volumes for project roottestkeeperrestorefromsnapshot_gw9 are DRIVER VOLUME NAME (cluster.py:871, print_all_docker_pieces) 2026-04-29 22:46:39 [ 539 ] DEBUG : Command:docker container list --all --filter name='^/roottestkeeperrestorefromsnapshot_gw9_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-04-29 22:46:39 [ 539 ] DEBUG : Unstopped containers: {} (cluster.py:890, cleanup) 2026-04-29 22:46:39 [ 539 ] DEBUG : No running containers for project: roottestkeeperrestorefromsnapshot_gw9 (cluster.py:904, cleanup) 2026-04-29 22:46:39 [ 539 ] DEBUG : Trying to prune unused networks... (cluster.py:910, cleanup) 2026-04-29 22:46:39 [ 539 ] DEBUG : Trying to prune unused images... (cluster.py:926, cleanup) 2026-04-29 22:46:39 [ 539 ] DEBUG : Command:['docker', 'image', 'prune', '-f'] (cluster.py:113, run_and_check) 2026-04-29 22:46:39 [ 539 ] DEBUG : Stdout:Total reclaimed space: 0B (cluster.py:121, run_and_check) 2026-04-29 22:46:39 [ 539 ] DEBUG : Images pruned (cluster.py:929, cleanup) 2026-04-29 22:46:39 [ 539 ] DEBUG : Trying to prune unused volumes... (cluster.py:935, cleanup) 2026-04-29 22:46:39 [ 539 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-04-29 22:46:40 [ 539 ] DEBUG : Stdout:11 (cluster.py:121, run_and_check) 2026-04-29 22:46:40 [ 539 ] DEBUG : Setup directory for instance: node1 (cluster.py:2808, start) 2026-04-29 22:46:40 [ 539 ] DEBUG : Create directory for configuration generated in this helper (cluster.py:4534, create_dir) 2026-04-29 22:46:40 [ 539 ] DEBUG : Create directory for common tests configuration (cluster.py:4539, create_dir) 2026-04-29 22:46:40 [ 539 ] DEBUG : Copy common configuration from helpers (cluster.py:4559, create_dir) 2026-04-29 22:46:40 [ 539 ] DEBUG : Generate and write macros file (cluster.py:4602, create_dir) 2026-04-29 22:46:40 [ 539 ] DEBUG : Copy custom test config files ['/ClickHouse/tests/integration/test_keeper_restore_from_snapshot/configs/enable_keeper1.xml', '/ClickHouse/tests/integration/test_keeper_restore_from_snapshot/configs/local_storage_path.xml'] to /ClickHouse/tests/integration/test_keeper_restore_from_snapshot/_instances_0_gw9/node1/configs/config.d (cluster.py:4632, create_dir) 2026-04-29 22:46:40 [ 539 ] DEBUG : Setup database dir /ClickHouse/tests/integration/test_keeper_restore_from_snapshot/_instances_0_gw9/node1/database (cluster.py:4649, create_dir) 2026-04-29 22:46:40 [ 539 ] DEBUG : Setup logs dir /ClickHouse/tests/integration/test_keeper_restore_from_snapshot/_instances_0_gw9/node1/logs (cluster.py:4660, create_dir) 2026-04-29 22:46:40 [ 539 ] DEBUG : Entrypoint cmd: bash -c "trap 'pkill tail' INT TERM; clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon; coproc tail -f /dev/null; wait $$!" (cluster.py:4746, create_dir) 2026-04-29 22:46:40 [ 539 ] DEBUG : Setup directory for instance: node2 (cluster.py:2808, start) 2026-04-29 22:46:40 [ 539 ] DEBUG : Create directory for configuration generated in this helper (cluster.py:4534, create_dir) 2026-04-29 22:46:40 [ 539 ] DEBUG : Create directory for common tests configuration (cluster.py:4539, create_dir) 2026-04-29 22:46:40 [ 539 ] DEBUG : Copy common configuration from helpers (cluster.py:4559, create_dir) 2026-04-29 22:46:40 [ 539 ] DEBUG : Generate and write macros file (cluster.py:4602, create_dir) 2026-04-29 22:46:40 [ 539 ] DEBUG : Copy custom test config files ['/ClickHouse/tests/integration/test_keeper_restore_from_snapshot/configs/enable_keeper2.xml', '/ClickHouse/tests/integration/test_keeper_restore_from_snapshot/configs/local_storage_path.xml'] to /ClickHouse/tests/integration/test_keeper_restore_from_snapshot/_instances_0_gw9/node2/configs/config.d (cluster.py:4632, create_dir) 2026-04-29 22:46:40 [ 539 ] DEBUG : Setup database dir /ClickHouse/tests/integration/test_keeper_restore_from_snapshot/_instances_0_gw9/node2/database (cluster.py:4649, create_dir) 2026-04-29 22:46:40 [ 539 ] DEBUG : Setup logs dir /ClickHouse/tests/integration/test_keeper_restore_from_snapshot/_instances_0_gw9/node2/logs (cluster.py:4660, create_dir) 2026-04-29 22:46:40 [ 539 ] DEBUG : Entrypoint cmd: bash -c "trap 'pkill tail' INT TERM; clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon; coproc tail -f /dev/null; wait $$!" (cluster.py:4746, create_dir) 2026-04-29 22:46:40 [ 539 ] DEBUG : Setup directory for instance: node3 (cluster.py:2808, start) 2026-04-29 22:46:40 [ 539 ] DEBUG : Create directory for configuration generated in this helper (cluster.py:4534, create_dir) 2026-04-29 22:46:40 [ 539 ] DEBUG : Create directory for common tests configuration (cluster.py:4539, create_dir) 2026-04-29 22:46:40 [ 539 ] DEBUG : Copy common configuration from helpers (cluster.py:4559, create_dir) 2026-04-29 22:46:40 [ 539 ] DEBUG : Generate and write macros file (cluster.py:4602, create_dir) 2026-04-29 22:46:40 [ 539 ] DEBUG : Copy custom test config files ['/ClickHouse/tests/integration/test_keeper_restore_from_snapshot/configs/enable_keeper3.xml', '/ClickHouse/tests/integration/test_keeper_restore_from_snapshot/configs/local_storage_path.xml'] to /ClickHouse/tests/integration/test_keeper_restore_from_snapshot/_instances_0_gw9/node3/configs/config.d (cluster.py:4632, create_dir) 2026-04-29 22:46:40 [ 539 ] DEBUG : Setup database dir /ClickHouse/tests/integration/test_keeper_restore_from_snapshot/_instances_0_gw9/node3/database (cluster.py:4649, create_dir) 2026-04-29 22:46:40 [ 539 ] DEBUG : Setup logs dir /ClickHouse/tests/integration/test_keeper_restore_from_snapshot/_instances_0_gw9/node3/logs (cluster.py:4660, create_dir) 2026-04-29 22:46:40 [ 539 ] DEBUG : Entrypoint cmd: bash -c "trap 'pkill tail' INT TERM; clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon; coproc tail -f /dev/null; wait $$!" (cluster.py:4746, create_dir) 2026-04-29 22:46:40 [ 539 ] DEBUG : Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw'} stored in /ClickHouse/tests/integration/test_keeper_restore_from_snapshot/_instances_0_gw9/.env (cluster.py:86, _create_env_file) 2026-04-29 22:46:40 [ 539 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2026-04-29 22:46:40 [ 539 ] DEBUG : No config file found (config.py:28, find_config_file) 2026-04-29 22:46:40 [ 539 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2026-04-29 22:46:40 [ 539 ] DEBUG : No config file found (config.py:28, find_config_file) 2026-04-29 22:46:40 [ 539 ] DEBUG : http://localhost:None "GET /version HTTP/1.1" 200 824 (connectionpool.py:547, _make_request) 2026-04-29 22:46:40 [ 539 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_keeper_restore_from_snapshot/_instances_0_gw9/.env', '--project-name', 'roottestkeeperrestorefromsnapshot_gw9', '--file', '/ClickHouse/tests/integration/test_keeper_restore_from_snapshot/_instances_0_gw9/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_keeper_restore_from_snapshot/_instances_0_gw9/node2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_keeper_restore_from_snapshot/_instances_0_gw9/node3/docker-compose.yml', 'pull'] (cluster.py:113, run_and_check) 2026-04-29 22:46:59 [ 539 ] WARNING : Connection dropped: socket connection error: None (connection.py:622, _connect_attempt) 2026-04-29 22:47:17 [ 539 ] DEBUG : Stderr:Pulling node1 ... (cluster.py:123, run_and_check) 2026-04-29 22:47:17 [ 539 ] DEBUG : Stderr:Pulling node2 ... (cluster.py:123, run_and_check) 2026-04-29 22:47:17 [ 539 ] DEBUG : Stderr:Pulling node3 ... (cluster.py:123, run_and_check) 2026-04-29 22:47:17 [ 539 ] DEBUG : Stderr:Pulling node3 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-04-29 22:47:17 [ 539 ] DEBUG : Stderr:Pulling node2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-04-29 22:47:17 [ 539 ] DEBUG : Stderr:Pulling node1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-04-29 22:47:17 [ 539 ] DEBUG : Stderr:Pulling node3 ... digest: sha256:bf725030a292d5daab... (cluster.py:123, run_and_check) 2026-04-29 22:47:17 [ 539 ] DEBUG : Stderr:Pulling node3 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-04-29 22:47:17 [ 539 ] DEBUG : Stderr:Pulling node3 ... done (cluster.py:123, run_and_check) 2026-04-29 22:47:17 [ 539 ] DEBUG : Stderr:Pulling node1 ... digest: sha256:bf725030a292d5daab... (cluster.py:123, run_and_check) 2026-04-29 22:47:17 [ 539 ] DEBUG : Stderr:Pulling node1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-04-29 22:47:17 [ 539 ] DEBUG : Stderr:Pulling node1 ... done (cluster.py:123, run_and_check) 2026-04-29 22:47:17 [ 539 ] DEBUG : Stderr:Pulling node2 ... digest: sha256:bf725030a292d5daab... (cluster.py:123, run_and_check) 2026-04-29 22:47:17 [ 539 ] DEBUG : Stderr:Pulling node2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-04-29 22:47:17 [ 539 ] DEBUG : Stderr:Pulling node2 ... done (cluster.py:123, run_and_check) 2026-04-29 22:47:17 [ 539 ] DEBUG : ('Trying to create ClickHouse instance by command %s', 'docker-compose --env-file /ClickHouse/tests/integration/test_keeper_restore_from_snapshot/_instances_0_gw9/.env --project-name roottestkeeperrestorefromsnapshot_gw9 --file /ClickHouse/tests/integration/test_keeper_restore_from_snapshot/_instances_0_gw9/node1/docker-compose.yml --file /ClickHouse/tests/integration/test_keeper_restore_from_snapshot/_instances_0_gw9/node2/docker-compose.yml --file /ClickHouse/tests/integration/test_keeper_restore_from_snapshot/_instances_0_gw9/node3/docker-compose.yml up -d --no-recreate') (cluster.py:3146, start) 2026-04-29 22:47:17 [ 539 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_keeper_restore_from_snapshot/_instances_0_gw9/.env', '--project-name', 'roottestkeeperrestorefromsnapshot_gw9', '--file', '/ClickHouse/tests/integration/test_keeper_restore_from_snapshot/_instances_0_gw9/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_keeper_restore_from_snapshot/_instances_0_gw9/node2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_keeper_restore_from_snapshot/_instances_0_gw9/node3/docker-compose.yml', 'up', '-d', '--no-recreate'] (cluster.py:113, run_and_check) 2026-04-29 22:47:21 [ 539 ] INFO : Connecting to 172.16.5.2(172.16.5.2):9181, use_ssl: False (connection.py:650, _connect) 2026-04-29 22:47:22 [ 539 ] DEBUG : Stderr:Creating network "roottestkeeperrestorefromsnapshot_gw9_default" with the default driver (cluster.py:123, run_and_check) 2026-04-29 22:47:22 [ 539 ] DEBUG : Stderr:Creating roottestkeeperrestorefromsnapshot_gw9_node2_1 ... (cluster.py:123, run_and_check) 2026-04-29 22:47:22 [ 539 ] DEBUG : Stderr:Creating roottestkeeperrestorefromsnapshot_gw9_node1_1 ... (cluster.py:123, run_and_check) 2026-04-29 22:47:22 [ 539 ] DEBUG : Stderr:Creating roottestkeeperrestorefromsnapshot_gw9_node3_1 ... (cluster.py:123, run_and_check) 2026-04-29 22:47:22 [ 539 ] DEBUG : Stderr:Creating roottestkeeperrestorefromsnapshot_gw9_node2_1 ... done (cluster.py:123, run_and_check) 2026-04-29 22:47:22 [ 539 ] DEBUG : Stderr:Creating roottestkeeperrestorefromsnapshot_gw9_node3_1 ... done (cluster.py:123, run_and_check) 2026-04-29 22:47:22 [ 539 ] DEBUG : Stderr:Creating roottestkeeperrestorefromsnapshot_gw9_node1_1 ... done (cluster.py:123, run_and_check) 2026-04-29 22:47:22 [ 539 ] DEBUG : ClickHouse instance created (cluster.py:3154, start) 2026-04-29 22:47:22 [ 539 ] DEBUG : get_instance_ip instance_name=node1 (cluster.py:2135, get_instance_ip) 2026-04-29 22:47:22 [ 539 ] DEBUG : http://localhost:None "GET /v1.42/containers/roottestkeeperrestorefromsnapshot_gw9_node1_1/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-04-29 22:47:22 [ 539 ] DEBUG : Waiting for ClickHouse start in node1, ip: 172.16.25.4... (cluster.py:3161, start) 2026-04-29 22:47:22 [ 539 ] DEBUG : http://localhost:None "GET /v1.42/containers/roottestkeeperrestorefromsnapshot_gw9_node1_1/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-04-29 22:47:22 [ 539 ] DEBUG : http://localhost:None "GET /v1.42/containers/363d47b7d99c5908db202e2cb888a0456e16e919fa53502caff3ffc29cffd5f3/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-04-29 22:47:22 [ 539 ] DEBUG : http://localhost:None "GET /v1.42/containers/363d47b7d99c5908db202e2cb888a0456e16e919fa53502caff3ffc29cffd5f3/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-04-29 22:47:22 [ 539 ] DEBUG : http://localhost:None "GET /v1.42/containers/363d47b7d99c5908db202e2cb888a0456e16e919fa53502caff3ffc29cffd5f3/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-04-29 22:47:22 [ 539 ] DEBUG : http://localhost:None "GET /v1.42/containers/363d47b7d99c5908db202e2cb888a0456e16e919fa53502caff3ffc29cffd5f3/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-04-29 22:47:22 [ 539 ] DEBUG : http://localhost:None "GET /v1.42/containers/363d47b7d99c5908db202e2cb888a0456e16e919fa53502caff3ffc29cffd5f3/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-04-29 22:47:23 [ 539 ] DEBUG : http://localhost:None "GET /v1.42/containers/363d47b7d99c5908db202e2cb888a0456e16e919fa53502caff3ffc29cffd5f3/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-04-29 22:47:23 [ 539 ] DEBUG : http://localhost:None "GET /v1.42/containers/363d47b7d99c5908db202e2cb888a0456e16e919fa53502caff3ffc29cffd5f3/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-04-29 22:47:23 [ 539 ] DEBUG : http://localhost:None "GET /v1.42/containers/363d47b7d99c5908db202e2cb888a0456e16e919fa53502caff3ffc29cffd5f3/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-04-29 22:47:23 [ 539 ] DEBUG : http://localhost:None "GET /v1.42/containers/363d47b7d99c5908db202e2cb888a0456e16e919fa53502caff3ffc29cffd5f3/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-04-29 22:47:23 [ 539 ] DEBUG : http://localhost:None "GET /v1.42/containers/363d47b7d99c5908db202e2cb888a0456e16e919fa53502caff3ffc29cffd5f3/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-04-29 22:47:23 [ 539 ] DEBUG : http://localhost:None "GET /v1.42/containers/363d47b7d99c5908db202e2cb888a0456e16e919fa53502caff3ffc29cffd5f3/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-04-29 22:47:23 [ 539 ] DEBUG : http://localhost:None "GET /v1.42/containers/363d47b7d99c5908db202e2cb888a0456e16e919fa53502caff3ffc29cffd5f3/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-04-29 22:47:23 [ 539 ] DEBUG : http://localhost:None "GET /v1.42/containers/363d47b7d99c5908db202e2cb888a0456e16e919fa53502caff3ffc29cffd5f3/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-04-29 22:47:23 [ 539 ] DEBUG : http://localhost:None "GET /v1.42/containers/363d47b7d99c5908db202e2cb888a0456e16e919fa53502caff3ffc29cffd5f3/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-04-29 22:47:24 [ 539 ] DEBUG : http://localhost:None "GET /v1.42/containers/363d47b7d99c5908db202e2cb888a0456e16e919fa53502caff3ffc29cffd5f3/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-04-29 22:47:24 [ 539 ] DEBUG : http://localhost:None "GET /v1.42/containers/363d47b7d99c5908db202e2cb888a0456e16e919fa53502caff3ffc29cffd5f3/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-04-29 22:47:24 [ 539 ] DEBUG : http://localhost:None "GET /v1.42/containers/363d47b7d99c5908db202e2cb888a0456e16e919fa53502caff3ffc29cffd5f3/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-04-29 22:47:24 [ 539 ] DEBUG : http://localhost:None "GET /v1.42/containers/363d47b7d99c5908db202e2cb888a0456e16e919fa53502caff3ffc29cffd5f3/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-04-29 22:47:24 [ 539 ] DEBUG : http://localhost:None "GET /v1.42/containers/363d47b7d99c5908db202e2cb888a0456e16e919fa53502caff3ffc29cffd5f3/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-04-29 22:47:24 [ 539 ] DEBUG : http://localhost:None "GET /v1.42/containers/363d47b7d99c5908db202e2cb888a0456e16e919fa53502caff3ffc29cffd5f3/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-04-29 22:47:24 [ 539 ] DEBUG : http://localhost:None "GET /v1.42/containers/363d47b7d99c5908db202e2cb888a0456e16e919fa53502caff3ffc29cffd5f3/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-04-29 22:47:24 [ 539 ] DEBUG : http://localhost:None "GET /v1.42/containers/363d47b7d99c5908db202e2cb888a0456e16e919fa53502caff3ffc29cffd5f3/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-04-29 22:47:24 [ 539 ] DEBUG : http://localhost:None "GET /v1.42/containers/363d47b7d99c5908db202e2cb888a0456e16e919fa53502caff3ffc29cffd5f3/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-04-29 22:47:25 [ 539 ] DEBUG : http://localhost:None "GET /v1.42/containers/363d47b7d99c5908db202e2cb888a0456e16e919fa53502caff3ffc29cffd5f3/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-04-29 22:47:25 [ 539 ] DEBUG : http://localhost:None "GET /v1.42/containers/363d47b7d99c5908db202e2cb888a0456e16e919fa53502caff3ffc29cffd5f3/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-04-29 22:47:25 [ 539 ] DEBUG : http://localhost:None "GET /v1.42/containers/363d47b7d99c5908db202e2cb888a0456e16e919fa53502caff3ffc29cffd5f3/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-04-29 22:47:25 [ 539 ] DEBUG : http://localhost:None "GET /v1.42/containers/363d47b7d99c5908db202e2cb888a0456e16e919fa53502caff3ffc29cffd5f3/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-04-29 22:47:25 [ 539 ] DEBUG : http://localhost:None "GET /v1.42/containers/363d47b7d99c5908db202e2cb888a0456e16e919fa53502caff3ffc29cffd5f3/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-04-29 22:47:25 [ 539 ] DEBUG : http://localhost:None "GET /v1.42/containers/363d47b7d99c5908db202e2cb888a0456e16e919fa53502caff3ffc29cffd5f3/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-04-29 22:47:25 [ 539 ] DEBUG : http://localhost:None "GET /v1.42/containers/363d47b7d99c5908db202e2cb888a0456e16e919fa53502caff3ffc29cffd5f3/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-04-29 22:47:25 [ 539 ] DEBUG : http://localhost:None "GET /v1.42/containers/363d47b7d99c5908db202e2cb888a0456e16e919fa53502caff3ffc29cffd5f3/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-04-29 22:47:26 [ 539 ] DEBUG : http://localhost:None "GET /v1.42/containers/363d47b7d99c5908db202e2cb888a0456e16e919fa53502caff3ffc29cffd5f3/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-04-29 22:47:26 [ 539 ] DEBUG : ClickHouse node1 started (cluster.py:3165, start) 2026-04-29 22:47:26 [ 539 ] DEBUG : get_instance_ip instance_name=node2 (cluster.py:2135, get_instance_ip) 2026-04-29 22:47:26 [ 539 ] DEBUG : http://localhost:None "GET /v1.42/containers/roottestkeeperrestorefromsnapshot_gw9_node2_1/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-04-29 22:47:26 [ 539 ] DEBUG : Waiting for ClickHouse start in node2, ip: 172.16.25.2... (cluster.py:3161, start) 2026-04-29 22:47:26 [ 539 ] DEBUG : http://localhost:None "GET /v1.42/containers/roottestkeeperrestorefromsnapshot_gw9_node2_1/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-04-29 22:47:26 [ 539 ] DEBUG : http://localhost:None "GET /v1.42/containers/112077d94924106af7d0fff3e73e341e5df32b652248460d74de53658750f032/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-04-29 22:47:26 [ 539 ] DEBUG : ClickHouse node2 started (cluster.py:3165, start) 2026-04-29 22:47:26 [ 539 ] DEBUG : get_instance_ip instance_name=node3 (cluster.py:2135, get_instance_ip) 2026-04-29 22:47:26 [ 539 ] DEBUG : http://localhost:None "GET /v1.42/containers/roottestkeeperrestorefromsnapshot_gw9_node3_1/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-04-29 22:47:26 [ 539 ] DEBUG : Waiting for ClickHouse start in node3, ip: 172.16.25.3... (cluster.py:3161, start) 2026-04-29 22:47:26 [ 539 ] DEBUG : http://localhost:None "GET /v1.42/containers/roottestkeeperrestorefromsnapshot_gw9_node3_1/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-04-29 22:47:26 [ 539 ] DEBUG : http://localhost:None "GET /v1.42/containers/b422ef30d89746c8ec3e4595c0d9f46047f2a4149824ef3fa94047b46bf375cd/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-04-29 22:47:26 [ 539 ] DEBUG : ClickHouse node3 started (cluster.py:3165, start) ----------------------------- Captured stdout call ----------------------------- Restarted ------------------------------ Captured log call ------------------------------- 2026-04-29 22:47:26 [ 539 ] DEBUG : get_instance_ip instance_name=node1 (cluster.py:2135, get_instance_ip) 2026-04-29 22:47:26 [ 539 ] DEBUG : http://localhost:None "GET /v1.42/containers/roottestkeeperrestorefromsnapshot_gw9_node1_1/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-04-29 22:47:26 [ 539 ] INFO : Connecting to 172.16.25.4(172.16.25.4):9181, use_ssl: False (connection.py:650, _connect) 2026-04-29 22:47:26 [ 539 ] DEBUG : Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) (connection.py:312, _submit) 2026-04-29 22:47:26 [ 539 ] INFO : Zookeeper connection established, state: CONNECTED (client.py:532, _session_callback) 2026-04-29 22:47:26 [ 539 ] DEBUG : get_instance_ip instance_name=node2 (cluster.py:2135, get_instance_ip) 2026-04-29 22:47:26 [ 539 ] DEBUG : http://localhost:None "GET /v1.42/containers/roottestkeeperrestorefromsnapshot_gw9_node2_1/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-04-29 22:47:26 [ 539 ] INFO : Connecting to 172.16.25.2(172.16.25.2):9181, use_ssl: False (connection.py:650, _connect) 2026-04-29 22:47:26 [ 539 ] DEBUG : Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) (connection.py:312, _submit) 2026-04-29 22:47:26 [ 539 ] INFO : Zookeeper connection established, state: CONNECTED (client.py:532, _session_callback) 2026-04-29 22:47:26 [ 539 ] DEBUG : get_instance_ip instance_name=node3 (cluster.py:2135, get_instance_ip) 2026-04-29 22:47:26 [ 539 ] DEBUG : http://localhost:None "GET /v1.42/containers/roottestkeeperrestorefromsnapshot_gw9_node3_1/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-04-29 22:47:26 [ 539 ] INFO : Connecting to 172.16.25.3(172.16.25.3):9181, use_ssl: False (connection.py:650, _connect) 2026-04-29 22:47:26 [ 539 ] DEBUG : Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) (connection.py:312, _submit) 2026-04-29 22:47:26 [ 539 ] INFO : Zookeeper connection established, state: CONNECTED (client.py:532, _session_callback) 2026-04-29 22:47:26 [ 539 ] DEBUG : Sending request(xid=1): Create(path='/test_snapshot_multinode_recover', data=b'somedata', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:26 [ 539 ] DEBUG : Received response(xid=1): '/test_snapshot_multinode_recover' (connection.py:410, _read_response) 2026-04-29 22:47:26 [ 539 ] DEBUG : Sending request(xid=1): Sync(path='/test_snapshot_multinode_recover') (connection.py:312, _submit) 2026-04-29 22:47:26 [ 539 ] DEBUG : Received response(xid=1): '/test_snapshot_multinode_recover' (connection.py:410, _read_response) 2026-04-29 22:47:26 [ 539 ] DEBUG : Sending request(xid=1): Sync(path='/test_snapshot_multinode_recover') (connection.py:312, _submit) 2026-04-29 22:47:26 [ 539 ] DEBUG : Received response(xid=1): '/test_snapshot_multinode_recover' (connection.py:410, _read_response) 2026-04-29 22:47:26 [ 539 ] DEBUG : Sending request(xid=2): GetData(path='/test_snapshot_multinode_recover', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:26 [ 539 ] DEBUG : Received response(xid=2): (b'somedata', ZnodeStat(czxid=16, mzxid=16, ctime=1777502846384, mtime=1777502846384, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=8, numChildren=0, pzxid=16)) (connection.py:410, _read_response) 2026-04-29 22:47:26 [ 539 ] DEBUG : Sending request(xid=2): GetData(path='/test_snapshot_multinode_recover', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:26 [ 539 ] DEBUG : Received response(xid=2): (b'somedata', ZnodeStat(czxid=16, mzxid=16, ctime=1777502846384, mtime=1777502846384, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=8, numChildren=0, pzxid=16)) (connection.py:410, _read_response) 2026-04-29 22:47:26 [ 539 ] DEBUG : Sending request(xid=2): GetData(path='/test_snapshot_multinode_recover', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:26 [ 539 ] DEBUG : Received response(xid=2): (b'somedata', ZnodeStat(czxid=16, mzxid=16, ctime=1777502846384, mtime=1777502846384, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=8, numChildren=0, pzxid=16)) (connection.py:410, _read_response) 2026-04-29 22:47:26 [ 539 ] DEBUG : run container_id:roottestkeeperrestorefromsnapshot_gw9_node3_1 detach:False nothrow:True cmd: ['bash', '-c', 'ps -C clickhouse'] (cluster.py:2173, exec_in_container) 2026-04-29 22:47:26 [ 539 ] DEBUG : Command:['docker', 'exec', '-u', 'root', 'roottestkeeperrestorefromsnapshot_gw9_node3_1', 'bash', '-c', 'ps -C clickhouse'] (cluster.py:113, run_and_check) 2026-04-29 22:47:27 [ 539 ] DEBUG : Stdout: PID TTY TIME CMD (cluster.py:121, run_and_check) 2026-04-29 22:47:27 [ 539 ] DEBUG : Stdout: 9 ? 00:00:03 clickhouse (cluster.py:121, run_and_check) 2026-04-29 22:47:27 [ 539 ] DEBUG : run container_id:roottestkeeperrestorefromsnapshot_gw9_node3_1 detach:False nothrow:False cmd: ['bash', '-c', 'pkill -9 clickhouse'] (cluster.py:2173, exec_in_container) 2026-04-29 22:47:27 [ 539 ] DEBUG : Command:['docker', 'exec', '-u', 'root', 'roottestkeeperrestorefromsnapshot_gw9_node3_1', 'bash', '-c', 'pkill -9 clickhouse'] (cluster.py:113, run_and_check) 2026-04-29 22:47:27 [ 539 ] DEBUG : run container_id:roottestkeeperrestorefromsnapshot_gw9_node3_1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2173, exec_in_container) 2026-04-29 22:47:27 [ 539 ] DEBUG : Command:['docker', 'exec', 'roottestkeeperrestorefromsnapshot_gw9_node3_1', 'bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:113, run_and_check) 2026-04-29 22:47:27 [ 539 ] WARNING : Connection dropped: socket connection broken (connection.py:622, _connect_attempt) 2026-04-29 22:47:27 [ 539 ] WARNING : Transition to CONNECTING (connection.py:626, _connect_attempt) 2026-04-29 22:47:27 [ 539 ] INFO : Zookeeper connection lost (client.py:543, _session_callback) 2026-04-29 22:47:27 [ 539 ] INFO : Connecting to 172.16.25.3(172.16.25.3):9181, use_ssl: False (connection.py:650, _connect) 2026-04-29 22:47:27 [ 539 ] WARNING : Connection dropped: socket connection error: Connection refused (connection.py:622, _connect_attempt) 2026-04-29 22:47:27 [ 539 ] INFO : Connecting to 172.16.25.3(172.16.25.3):9181, use_ssl: False (connection.py:650, _connect) 2026-04-29 22:47:27 [ 539 ] WARNING : Connection dropped: socket connection error: Connection refused (connection.py:622, _connect_attempt) 2026-04-29 22:47:28 [ 539 ] DEBUG : Sending request(xid=3): Create(path='/test_snapshot_multinode_recover0', data=b'somedata0', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:28 [ 539 ] DEBUG : Received response(xid=3): '/test_snapshot_multinode_recover0' (connection.py:410, _read_response) 2026-04-29 22:47:28 [ 539 ] DEBUG : Sending request(xid=4): Create(path='/test_snapshot_multinode_recover1', data=b'somedata1', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:28 [ 539 ] DEBUG : Received response(xid=4): '/test_snapshot_multinode_recover1' (connection.py:410, _read_response) 2026-04-29 22:47:28 [ 539 ] DEBUG : Sending request(xid=5): Create(path='/test_snapshot_multinode_recover2', data=b'somedata2', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:28 [ 539 ] DEBUG : Received response(xid=5): '/test_snapshot_multinode_recover2' (connection.py:410, _read_response) 2026-04-29 22:47:28 [ 539 ] DEBUG : Sending request(xid=6): Create(path='/test_snapshot_multinode_recover3', data=b'somedata3', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:28 [ 539 ] DEBUG : Received response(xid=6): '/test_snapshot_multinode_recover3' (connection.py:410, _read_response) 2026-04-29 22:47:28 [ 539 ] DEBUG : Sending request(xid=7): Create(path='/test_snapshot_multinode_recover4', data=b'somedata4', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:28 [ 539 ] DEBUG : Received response(xid=7): '/test_snapshot_multinode_recover4' (connection.py:410, _read_response) 2026-04-29 22:47:28 [ 539 ] DEBUG : Sending request(xid=8): Create(path='/test_snapshot_multinode_recover5', data=b'somedata5', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:28 [ 539 ] DEBUG : Received response(xid=8): '/test_snapshot_multinode_recover5' (connection.py:410, _read_response) 2026-04-29 22:47:28 [ 539 ] DEBUG : Sending request(xid=9): Create(path='/test_snapshot_multinode_recover6', data=b'somedata6', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:28 [ 539 ] DEBUG : Received response(xid=9): '/test_snapshot_multinode_recover6' (connection.py:410, _read_response) 2026-04-29 22:47:28 [ 539 ] DEBUG : Sending request(xid=10): Create(path='/test_snapshot_multinode_recover7', data=b'somedata7', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:28 [ 539 ] DEBUG : Received response(xid=10): '/test_snapshot_multinode_recover7' (connection.py:410, _read_response) 2026-04-29 22:47:28 [ 539 ] DEBUG : Sending request(xid=11): Create(path='/test_snapshot_multinode_recover8', data=b'somedata8', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:28 [ 539 ] DEBUG : Received response(xid=11): '/test_snapshot_multinode_recover8' (connection.py:410, _read_response) 2026-04-29 22:47:28 [ 539 ] DEBUG : Sending request(xid=12): Create(path='/test_snapshot_multinode_recover9', data=b'somedata9', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:28 [ 539 ] DEBUG : Received response(xid=12): '/test_snapshot_multinode_recover9' (connection.py:410, _read_response) 2026-04-29 22:47:28 [ 539 ] DEBUG : Sending request(xid=13): Create(path='/test_snapshot_multinode_recover10', data=b'somedata10', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:28 [ 539 ] INFO : Connecting to 172.16.25.3(172.16.25.3):9181, use_ssl: False (connection.py:650, _connect) 2026-04-29 22:47:28 [ 539 ] WARNING : Connection dropped: socket connection error: Connection refused (connection.py:622, _connect_attempt) 2026-04-29 22:47:28 [ 539 ] DEBUG : Received response(xid=13): '/test_snapshot_multinode_recover10' (connection.py:410, _read_response) 2026-04-29 22:47:28 [ 539 ] DEBUG : Sending request(xid=14): Create(path='/test_snapshot_multinode_recover11', data=b'somedata11', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:28 [ 539 ] DEBUG : Received response(xid=14): '/test_snapshot_multinode_recover11' (connection.py:410, _read_response) 2026-04-29 22:47:28 [ 539 ] DEBUG : Sending request(xid=15): Create(path='/test_snapshot_multinode_recover12', data=b'somedata12', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:28 [ 539 ] DEBUG : Received response(xid=15): '/test_snapshot_multinode_recover12' (connection.py:410, _read_response) 2026-04-29 22:47:28 [ 539 ] DEBUG : Sending request(xid=16): Create(path='/test_snapshot_multinode_recover13', data=b'somedata13', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:28 [ 539 ] DEBUG : Received response(xid=16): '/test_snapshot_multinode_recover13' (connection.py:410, _read_response) 2026-04-29 22:47:28 [ 539 ] DEBUG : Sending request(xid=17): Create(path='/test_snapshot_multinode_recover14', data=b'somedata14', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:28 [ 539 ] DEBUG : Received response(xid=17): '/test_snapshot_multinode_recover14' (connection.py:410, _read_response) 2026-04-29 22:47:28 [ 539 ] DEBUG : Sending request(xid=18): Create(path='/test_snapshot_multinode_recover15', data=b'somedata15', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:28 [ 539 ] DEBUG : Received response(xid=18): '/test_snapshot_multinode_recover15' (connection.py:410, _read_response) 2026-04-29 22:47:28 [ 539 ] DEBUG : Sending request(xid=19): Create(path='/test_snapshot_multinode_recover16', data=b'somedata16', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:28 [ 539 ] DEBUG : Received response(xid=19): '/test_snapshot_multinode_recover16' (connection.py:410, _read_response) 2026-04-29 22:47:28 [ 539 ] DEBUG : Sending request(xid=20): Create(path='/test_snapshot_multinode_recover17', data=b'somedata17', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:28 [ 539 ] DEBUG : Received response(xid=20): '/test_snapshot_multinode_recover17' (connection.py:410, _read_response) 2026-04-29 22:47:28 [ 539 ] DEBUG : Sending request(xid=21): Create(path='/test_snapshot_multinode_recover18', data=b'somedata18', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:28 [ 539 ] DEBUG : Received response(xid=21): '/test_snapshot_multinode_recover18' (connection.py:410, _read_response) 2026-04-29 22:47:28 [ 539 ] DEBUG : Sending request(xid=22): Create(path='/test_snapshot_multinode_recover19', data=b'somedata19', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:28 [ 539 ] DEBUG : Received response(xid=22): '/test_snapshot_multinode_recover19' (connection.py:410, _read_response) 2026-04-29 22:47:28 [ 539 ] DEBUG : Sending request(xid=23): Create(path='/test_snapshot_multinode_recover20', data=b'somedata20', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:28 [ 539 ] DEBUG : Received response(xid=23): '/test_snapshot_multinode_recover20' (connection.py:410, _read_response) 2026-04-29 22:47:28 [ 539 ] DEBUG : Sending request(xid=24): Create(path='/test_snapshot_multinode_recover21', data=b'somedata21', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:28 [ 539 ] DEBUG : Received response(xid=24): '/test_snapshot_multinode_recover21' (connection.py:410, _read_response) 2026-04-29 22:47:28 [ 539 ] DEBUG : Sending request(xid=25): Create(path='/test_snapshot_multinode_recover22', data=b'somedata22', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:28 [ 539 ] DEBUG : Received response(xid=25): '/test_snapshot_multinode_recover22' (connection.py:410, _read_response) 2026-04-29 22:47:28 [ 539 ] DEBUG : Sending request(xid=26): Create(path='/test_snapshot_multinode_recover23', data=b'somedata23', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:28 [ 539 ] DEBUG : Received response(xid=26): '/test_snapshot_multinode_recover23' (connection.py:410, _read_response) 2026-04-29 22:47:28 [ 539 ] DEBUG : Sending request(xid=27): Create(path='/test_snapshot_multinode_recover24', data=b'somedata24', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:28 [ 539 ] DEBUG : Received response(xid=27): '/test_snapshot_multinode_recover24' (connection.py:410, _read_response) 2026-04-29 22:47:28 [ 539 ] DEBUG : Sending request(xid=28): Create(path='/test_snapshot_multinode_recover25', data=b'somedata25', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:28 [ 539 ] DEBUG : Received response(xid=28): '/test_snapshot_multinode_recover25' (connection.py:410, _read_response) 2026-04-29 22:47:28 [ 539 ] DEBUG : Sending request(xid=29): Create(path='/test_snapshot_multinode_recover26', data=b'somedata26', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:28 [ 539 ] DEBUG : Received response(xid=29): '/test_snapshot_multinode_recover26' (connection.py:410, _read_response) 2026-04-29 22:47:28 [ 539 ] DEBUG : Sending request(xid=30): Create(path='/test_snapshot_multinode_recover27', data=b'somedata27', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:28 [ 539 ] DEBUG : Received response(xid=30): '/test_snapshot_multinode_recover27' (connection.py:410, _read_response) 2026-04-29 22:47:28 [ 539 ] DEBUG : Sending request(xid=31): Create(path='/test_snapshot_multinode_recover28', data=b'somedata28', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:28 [ 539 ] DEBUG : Received response(xid=31): '/test_snapshot_multinode_recover28' (connection.py:410, _read_response) 2026-04-29 22:47:28 [ 539 ] DEBUG : Sending request(xid=32): Create(path='/test_snapshot_multinode_recover29', data=b'somedata29', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:28 [ 539 ] DEBUG : Received response(xid=32): '/test_snapshot_multinode_recover29' (connection.py:410, _read_response) 2026-04-29 22:47:28 [ 539 ] DEBUG : Sending request(xid=33): Create(path='/test_snapshot_multinode_recover30', data=b'somedata30', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:28 [ 539 ] DEBUG : Received response(xid=33): '/test_snapshot_multinode_recover30' (connection.py:410, _read_response) 2026-04-29 22:47:28 [ 539 ] DEBUG : Sending request(xid=34): Create(path='/test_snapshot_multinode_recover31', data=b'somedata31', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:28 [ 539 ] DEBUG : Received response(xid=34): '/test_snapshot_multinode_recover31' (connection.py:410, _read_response) 2026-04-29 22:47:28 [ 539 ] DEBUG : Sending request(xid=35): Create(path='/test_snapshot_multinode_recover32', data=b'somedata32', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:28 [ 539 ] DEBUG : Received response(xid=35): '/test_snapshot_multinode_recover32' (connection.py:410, _read_response) 2026-04-29 22:47:28 [ 539 ] DEBUG : Sending request(xid=36): Create(path='/test_snapshot_multinode_recover33', data=b'somedata33', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:28 [ 539 ] DEBUG : Received response(xid=36): '/test_snapshot_multinode_recover33' (connection.py:410, _read_response) 2026-04-29 22:47:28 [ 539 ] DEBUG : Sending request(xid=37): Create(path='/test_snapshot_multinode_recover34', data=b'somedata34', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:28 [ 539 ] DEBUG : Received response(xid=37): '/test_snapshot_multinode_recover34' (connection.py:410, _read_response) 2026-04-29 22:47:28 [ 539 ] DEBUG : Sending request(xid=38): Create(path='/test_snapshot_multinode_recover35', data=b'somedata35', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:28 [ 539 ] DEBUG : Received response(xid=38): '/test_snapshot_multinode_recover35' (connection.py:410, _read_response) 2026-04-29 22:47:28 [ 539 ] DEBUG : Sending request(xid=39): Create(path='/test_snapshot_multinode_recover36', data=b'somedata36', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:28 [ 539 ] DEBUG : Received response(xid=39): '/test_snapshot_multinode_recover36' (connection.py:410, _read_response) 2026-04-29 22:47:28 [ 539 ] DEBUG : Sending request(xid=40): Create(path='/test_snapshot_multinode_recover37', data=b'somedata37', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:28 [ 539 ] INFO : Connecting to 172.16.25.3(172.16.25.3):9181, use_ssl: False (connection.py:650, _connect) 2026-04-29 22:47:28 [ 539 ] WARNING : Connection dropped: socket connection error: Connection refused (connection.py:622, _connect_attempt) 2026-04-29 22:47:28 [ 539 ] DEBUG : Received response(xid=40): '/test_snapshot_multinode_recover37' (connection.py:410, _read_response) 2026-04-29 22:47:28 [ 539 ] DEBUG : Sending request(xid=41): Create(path='/test_snapshot_multinode_recover38', data=b'somedata38', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:28 [ 539 ] DEBUG : Received response(xid=41): '/test_snapshot_multinode_recover38' (connection.py:410, _read_response) 2026-04-29 22:47:28 [ 539 ] DEBUG : Sending request(xid=42): Create(path='/test_snapshot_multinode_recover39', data=b'somedata39', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:28 [ 539 ] DEBUG : Received response(xid=42): '/test_snapshot_multinode_recover39' (connection.py:410, _read_response) 2026-04-29 22:47:28 [ 539 ] DEBUG : Sending request(xid=43): Create(path='/test_snapshot_multinode_recover40', data=b'somedata40', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:28 [ 539 ] DEBUG : Received response(xid=43): '/test_snapshot_multinode_recover40' (connection.py:410, _read_response) 2026-04-29 22:47:28 [ 539 ] DEBUG : Sending request(xid=44): Create(path='/test_snapshot_multinode_recover41', data=b'somedata41', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:28 [ 539 ] DEBUG : Received response(xid=44): '/test_snapshot_multinode_recover41' (connection.py:410, _read_response) 2026-04-29 22:47:28 [ 539 ] DEBUG : Sending request(xid=45): Create(path='/test_snapshot_multinode_recover42', data=b'somedata42', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:28 [ 539 ] DEBUG : Received response(xid=45): '/test_snapshot_multinode_recover42' (connection.py:410, _read_response) 2026-04-29 22:47:28 [ 539 ] DEBUG : Sending request(xid=46): Create(path='/test_snapshot_multinode_recover43', data=b'somedata43', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:29 [ 539 ] DEBUG : Received response(xid=46): '/test_snapshot_multinode_recover43' (connection.py:410, _read_response) 2026-04-29 22:47:29 [ 539 ] DEBUG : Sending request(xid=47): Create(path='/test_snapshot_multinode_recover44', data=b'somedata44', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:29 [ 539 ] DEBUG : Received response(xid=47): '/test_snapshot_multinode_recover44' (connection.py:410, _read_response) 2026-04-29 22:47:29 [ 539 ] DEBUG : Sending request(xid=48): Create(path='/test_snapshot_multinode_recover45', data=b'somedata45', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:29 [ 539 ] DEBUG : Received response(xid=48): '/test_snapshot_multinode_recover45' (connection.py:410, _read_response) 2026-04-29 22:47:29 [ 539 ] DEBUG : Sending request(xid=49): Create(path='/test_snapshot_multinode_recover46', data=b'somedata46', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:29 [ 539 ] DEBUG : Received response(xid=49): '/test_snapshot_multinode_recover46' (connection.py:410, _read_response) 2026-04-29 22:47:29 [ 539 ] DEBUG : Sending request(xid=50): Create(path='/test_snapshot_multinode_recover47', data=b'somedata47', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:29 [ 539 ] DEBUG : Received response(xid=50): '/test_snapshot_multinode_recover47' (connection.py:410, _read_response) 2026-04-29 22:47:29 [ 539 ] DEBUG : Sending request(xid=51): Create(path='/test_snapshot_multinode_recover48', data=b'somedata48', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:29 [ 539 ] DEBUG : Received response(xid=51): '/test_snapshot_multinode_recover48' (connection.py:410, _read_response) 2026-04-29 22:47:29 [ 539 ] DEBUG : Sending request(xid=52): Create(path='/test_snapshot_multinode_recover49', data=b'somedata49', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:29 [ 539 ] DEBUG : Received response(xid=52): '/test_snapshot_multinode_recover49' (connection.py:410, _read_response) 2026-04-29 22:47:29 [ 539 ] DEBUG : Sending request(xid=53): Create(path='/test_snapshot_multinode_recover50', data=b'somedata50', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:29 [ 539 ] DEBUG : Received response(xid=53): '/test_snapshot_multinode_recover50' (connection.py:410, _read_response) 2026-04-29 22:47:29 [ 539 ] DEBUG : Sending request(xid=54): Create(path='/test_snapshot_multinode_recover51', data=b'somedata51', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:29 [ 539 ] DEBUG : Received response(xid=54): '/test_snapshot_multinode_recover51' (connection.py:410, _read_response) 2026-04-29 22:47:29 [ 539 ] DEBUG : Sending request(xid=55): Create(path='/test_snapshot_multinode_recover52', data=b'somedata52', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:29 [ 539 ] DEBUG : Received response(xid=55): '/test_snapshot_multinode_recover52' (connection.py:410, _read_response) 2026-04-29 22:47:29 [ 539 ] DEBUG : Sending request(xid=56): Create(path='/test_snapshot_multinode_recover53', data=b'somedata53', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:29 [ 539 ] DEBUG : Received response(xid=56): '/test_snapshot_multinode_recover53' (connection.py:410, _read_response) 2026-04-29 22:47:29 [ 539 ] DEBUG : Sending request(xid=57): Create(path='/test_snapshot_multinode_recover54', data=b'somedata54', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:29 [ 539 ] DEBUG : Received response(xid=57): '/test_snapshot_multinode_recover54' (connection.py:410, _read_response) 2026-04-29 22:47:29 [ 539 ] DEBUG : Sending request(xid=58): Create(path='/test_snapshot_multinode_recover55', data=b'somedata55', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:29 [ 539 ] DEBUG : Received response(xid=58): '/test_snapshot_multinode_recover55' (connection.py:410, _read_response) 2026-04-29 22:47:29 [ 539 ] DEBUG : Sending request(xid=59): Create(path='/test_snapshot_multinode_recover56', data=b'somedata56', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:29 [ 539 ] DEBUG : Received response(xid=59): '/test_snapshot_multinode_recover56' (connection.py:410, _read_response) 2026-04-29 22:47:29 [ 539 ] DEBUG : Sending request(xid=60): Create(path='/test_snapshot_multinode_recover57', data=b'somedata57', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:29 [ 539 ] DEBUG : Received response(xid=60): '/test_snapshot_multinode_recover57' (connection.py:410, _read_response) 2026-04-29 22:47:29 [ 539 ] DEBUG : Sending request(xid=61): Create(path='/test_snapshot_multinode_recover58', data=b'somedata58', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:29 [ 539 ] DEBUG : Received response(xid=61): '/test_snapshot_multinode_recover58' (connection.py:410, _read_response) 2026-04-29 22:47:29 [ 539 ] DEBUG : Sending request(xid=62): Create(path='/test_snapshot_multinode_recover59', data=b'somedata59', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:29 [ 539 ] DEBUG : Received response(xid=62): '/test_snapshot_multinode_recover59' (connection.py:410, _read_response) 2026-04-29 22:47:29 [ 539 ] DEBUG : Sending request(xid=63): Create(path='/test_snapshot_multinode_recover60', data=b'somedata60', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:29 [ 539 ] DEBUG : Received response(xid=63): '/test_snapshot_multinode_recover60' (connection.py:410, _read_response) 2026-04-29 22:47:29 [ 539 ] DEBUG : Sending request(xid=64): Create(path='/test_snapshot_multinode_recover61', data=b'somedata61', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:29 [ 539 ] DEBUG : Received response(xid=64): '/test_snapshot_multinode_recover61' (connection.py:410, _read_response) 2026-04-29 22:47:29 [ 539 ] DEBUG : Sending request(xid=65): Create(path='/test_snapshot_multinode_recover62', data=b'somedata62', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:29 [ 539 ] DEBUG : Received response(xid=65): '/test_snapshot_multinode_recover62' (connection.py:410, _read_response) 2026-04-29 22:47:29 [ 539 ] DEBUG : Sending request(xid=66): Create(path='/test_snapshot_multinode_recover63', data=b'somedata63', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:29 [ 539 ] DEBUG : Received response(xid=66): '/test_snapshot_multinode_recover63' (connection.py:410, _read_response) 2026-04-29 22:47:29 [ 539 ] DEBUG : Sending request(xid=67): Create(path='/test_snapshot_multinode_recover64', data=b'somedata64', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:29 [ 539 ] DEBUG : Received response(xid=67): '/test_snapshot_multinode_recover64' (connection.py:410, _read_response) 2026-04-29 22:47:29 [ 539 ] DEBUG : Sending request(xid=68): Create(path='/test_snapshot_multinode_recover65', data=b'somedata65', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:29 [ 539 ] DEBUG : Received response(xid=68): '/test_snapshot_multinode_recover65' (connection.py:410, _read_response) 2026-04-29 22:47:29 [ 539 ] DEBUG : Sending request(xid=69): Create(path='/test_snapshot_multinode_recover66', data=b'somedata66', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:29 [ 539 ] INFO : Connecting to 172.16.25.3(172.16.25.3):9181, use_ssl: False (connection.py:650, _connect) 2026-04-29 22:47:29 [ 539 ] WARNING : Connection dropped: socket connection error: Connection refused (connection.py:622, _connect_attempt) 2026-04-29 22:47:29 [ 539 ] DEBUG : Received response(xid=69): '/test_snapshot_multinode_recover66' (connection.py:410, _read_response) 2026-04-29 22:47:29 [ 539 ] DEBUG : Sending request(xid=70): Create(path='/test_snapshot_multinode_recover67', data=b'somedata67', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:29 [ 539 ] DEBUG : Received response(xid=70): '/test_snapshot_multinode_recover67' (connection.py:410, _read_response) 2026-04-29 22:47:29 [ 539 ] DEBUG : Sending request(xid=71): Create(path='/test_snapshot_multinode_recover68', data=b'somedata68', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:29 [ 539 ] DEBUG : Received response(xid=71): '/test_snapshot_multinode_recover68' (connection.py:410, _read_response) 2026-04-29 22:47:29 [ 539 ] DEBUG : Sending request(xid=72): Create(path='/test_snapshot_multinode_recover69', data=b'somedata69', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:29 [ 539 ] DEBUG : Received response(xid=72): '/test_snapshot_multinode_recover69' (connection.py:410, _read_response) 2026-04-29 22:47:29 [ 539 ] DEBUG : Sending request(xid=73): Create(path='/test_snapshot_multinode_recover70', data=b'somedata70', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:29 [ 539 ] DEBUG : Received response(xid=73): '/test_snapshot_multinode_recover70' (connection.py:410, _read_response) 2026-04-29 22:47:29 [ 539 ] DEBUG : Sending request(xid=74): Create(path='/test_snapshot_multinode_recover71', data=b'somedata71', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:29 [ 539 ] DEBUG : Received response(xid=74): '/test_snapshot_multinode_recover71' (connection.py:410, _read_response) 2026-04-29 22:47:29 [ 539 ] DEBUG : Sending request(xid=75): Create(path='/test_snapshot_multinode_recover72', data=b'somedata72', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:29 [ 539 ] DEBUG : Received response(xid=75): '/test_snapshot_multinode_recover72' (connection.py:410, _read_response) 2026-04-29 22:47:29 [ 539 ] DEBUG : Sending request(xid=76): Create(path='/test_snapshot_multinode_recover73', data=b'somedata73', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:29 [ 539 ] DEBUG : Received response(xid=76): '/test_snapshot_multinode_recover73' (connection.py:410, _read_response) 2026-04-29 22:47:29 [ 539 ] DEBUG : Sending request(xid=77): Create(path='/test_snapshot_multinode_recover74', data=b'somedata74', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:29 [ 539 ] DEBUG : Received response(xid=77): '/test_snapshot_multinode_recover74' (connection.py:410, _read_response) 2026-04-29 22:47:29 [ 539 ] DEBUG : Sending request(xid=78): Create(path='/test_snapshot_multinode_recover75', data=b'somedata75', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:29 [ 539 ] DEBUG : Received response(xid=78): '/test_snapshot_multinode_recover75' (connection.py:410, _read_response) 2026-04-29 22:47:29 [ 539 ] DEBUG : Sending request(xid=79): Create(path='/test_snapshot_multinode_recover76', data=b'somedata76', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:29 [ 539 ] DEBUG : Received response(xid=79): '/test_snapshot_multinode_recover76' (connection.py:410, _read_response) 2026-04-29 22:47:29 [ 539 ] DEBUG : Sending request(xid=80): Create(path='/test_snapshot_multinode_recover77', data=b'somedata77', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:29 [ 539 ] DEBUG : Received response(xid=80): '/test_snapshot_multinode_recover77' (connection.py:410, _read_response) 2026-04-29 22:47:29 [ 539 ] DEBUG : Sending request(xid=81): Create(path='/test_snapshot_multinode_recover78', data=b'somedata78', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:29 [ 539 ] DEBUG : Received response(xid=81): '/test_snapshot_multinode_recover78' (connection.py:410, _read_response) 2026-04-29 22:47:29 [ 539 ] DEBUG : Sending request(xid=82): Create(path='/test_snapshot_multinode_recover79', data=b'somedata79', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:29 [ 539 ] DEBUG : Received response(xid=82): '/test_snapshot_multinode_recover79' (connection.py:410, _read_response) 2026-04-29 22:47:29 [ 539 ] DEBUG : Sending request(xid=83): Create(path='/test_snapshot_multinode_recover80', data=b'somedata80', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:29 [ 539 ] DEBUG : Received response(xid=83): '/test_snapshot_multinode_recover80' (connection.py:410, _read_response) 2026-04-29 22:47:29 [ 539 ] DEBUG : Sending request(xid=84): Create(path='/test_snapshot_multinode_recover81', data=b'somedata81', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:29 [ 539 ] DEBUG : Received response(xid=84): '/test_snapshot_multinode_recover81' (connection.py:410, _read_response) 2026-04-29 22:47:29 [ 539 ] DEBUG : Sending request(xid=85): Create(path='/test_snapshot_multinode_recover82', data=b'somedata82', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:29 [ 539 ] DEBUG : Received response(xid=85): '/test_snapshot_multinode_recover82' (connection.py:410, _read_response) 2026-04-29 22:47:29 [ 539 ] DEBUG : Sending request(xid=86): Create(path='/test_snapshot_multinode_recover83', data=b'somedata83', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:30 [ 539 ] DEBUG : Received response(xid=86): '/test_snapshot_multinode_recover83' (connection.py:410, _read_response) 2026-04-29 22:47:30 [ 539 ] DEBUG : Sending request(xid=87): Create(path='/test_snapshot_multinode_recover84', data=b'somedata84', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:30 [ 539 ] DEBUG : Received response(xid=87): '/test_snapshot_multinode_recover84' (connection.py:410, _read_response) 2026-04-29 22:47:30 [ 539 ] DEBUG : Sending request(xid=88): Create(path='/test_snapshot_multinode_recover85', data=b'somedata85', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:30 [ 539 ] DEBUG : Received response(xid=88): '/test_snapshot_multinode_recover85' (connection.py:410, _read_response) 2026-04-29 22:47:30 [ 539 ] DEBUG : Sending request(xid=89): Create(path='/test_snapshot_multinode_recover86', data=b'somedata86', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:30 [ 539 ] DEBUG : Received response(xid=89): '/test_snapshot_multinode_recover86' (connection.py:410, _read_response) 2026-04-29 22:47:30 [ 539 ] DEBUG : Sending request(xid=90): Create(path='/test_snapshot_multinode_recover87', data=b'somedata87', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:30 [ 539 ] DEBUG : Received response(xid=90): '/test_snapshot_multinode_recover87' (connection.py:410, _read_response) 2026-04-29 22:47:30 [ 539 ] DEBUG : Sending request(xid=91): Create(path='/test_snapshot_multinode_recover88', data=b'somedata88', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:30 [ 539 ] DEBUG : Received response(xid=91): '/test_snapshot_multinode_recover88' (connection.py:410, _read_response) 2026-04-29 22:47:30 [ 539 ] DEBUG : Sending request(xid=92): Create(path='/test_snapshot_multinode_recover89', data=b'somedata89', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:30 [ 539 ] DEBUG : Received response(xid=92): '/test_snapshot_multinode_recover89' (connection.py:410, _read_response) 2026-04-29 22:47:30 [ 539 ] DEBUG : Sending request(xid=93): Create(path='/test_snapshot_multinode_recover90', data=b'somedata90', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:30 [ 539 ] DEBUG : Received response(xid=93): '/test_snapshot_multinode_recover90' (connection.py:410, _read_response) 2026-04-29 22:47:30 [ 539 ] DEBUG : Sending request(xid=94): Create(path='/test_snapshot_multinode_recover91', data=b'somedata91', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:30 [ 539 ] DEBUG : Received response(xid=94): '/test_snapshot_multinode_recover91' (connection.py:410, _read_response) 2026-04-29 22:47:30 [ 539 ] DEBUG : Sending request(xid=95): Create(path='/test_snapshot_multinode_recover92', data=b'somedata92', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:30 [ 539 ] DEBUG : Received response(xid=95): '/test_snapshot_multinode_recover92' (connection.py:410, _read_response) 2026-04-29 22:47:30 [ 539 ] DEBUG : Sending request(xid=96): Create(path='/test_snapshot_multinode_recover93', data=b'somedata93', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:30 [ 539 ] DEBUG : Received response(xid=96): '/test_snapshot_multinode_recover93' (connection.py:410, _read_response) 2026-04-29 22:47:30 [ 539 ] DEBUG : Sending request(xid=97): Create(path='/test_snapshot_multinode_recover94', data=b'somedata94', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:30 [ 539 ] DEBUG : Received response(xid=97): '/test_snapshot_multinode_recover94' (connection.py:410, _read_response) 2026-04-29 22:47:30 [ 539 ] DEBUG : Sending request(xid=98): Create(path='/test_snapshot_multinode_recover95', data=b'somedata95', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:30 [ 539 ] DEBUG : Received response(xid=98): '/test_snapshot_multinode_recover95' (connection.py:410, _read_response) 2026-04-29 22:47:30 [ 539 ] DEBUG : Sending request(xid=99): Create(path='/test_snapshot_multinode_recover96', data=b'somedata96', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:30 [ 539 ] DEBUG : Received response(xid=99): '/test_snapshot_multinode_recover96' (connection.py:410, _read_response) 2026-04-29 22:47:30 [ 539 ] DEBUG : Sending request(xid=100): Create(path='/test_snapshot_multinode_recover97', data=b'somedata97', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:30 [ 539 ] DEBUG : Received response(xid=100): '/test_snapshot_multinode_recover97' (connection.py:410, _read_response) 2026-04-29 22:47:30 [ 539 ] DEBUG : Sending request(xid=101): Create(path='/test_snapshot_multinode_recover98', data=b'somedata98', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:30 [ 539 ] DEBUG : Received response(xid=101): '/test_snapshot_multinode_recover98' (connection.py:410, _read_response) 2026-04-29 22:47:30 [ 539 ] DEBUG : Sending request(xid=102): Create(path='/test_snapshot_multinode_recover99', data=b'somedata99', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:30 [ 539 ] DEBUG : Received response(xid=102): '/test_snapshot_multinode_recover99' (connection.py:410, _read_response) 2026-04-29 22:47:30 [ 539 ] DEBUG : Sending request(xid=103): Create(path='/test_snapshot_multinode_recover100', data=b'somedata100', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:30 [ 539 ] DEBUG : Received response(xid=103): '/test_snapshot_multinode_recover100' (connection.py:410, _read_response) 2026-04-29 22:47:30 [ 539 ] DEBUG : Sending request(xid=104): Create(path='/test_snapshot_multinode_recover101', data=b'somedata101', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:30 [ 539 ] DEBUG : Received response(xid=104): '/test_snapshot_multinode_recover101' (connection.py:410, _read_response) 2026-04-29 22:47:30 [ 539 ] DEBUG : Sending request(xid=105): Create(path='/test_snapshot_multinode_recover102', data=b'somedata102', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:30 [ 539 ] DEBUG : Received response(xid=105): '/test_snapshot_multinode_recover102' (connection.py:410, _read_response) 2026-04-29 22:47:30 [ 539 ] DEBUG : Sending request(xid=106): Create(path='/test_snapshot_multinode_recover103', data=b'somedata103', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:30 [ 539 ] DEBUG : Received response(xid=106): '/test_snapshot_multinode_recover103' (connection.py:410, _read_response) 2026-04-29 22:47:30 [ 539 ] DEBUG : Sending request(xid=107): Create(path='/test_snapshot_multinode_recover104', data=b'somedata104', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:30 [ 539 ] DEBUG : Received response(xid=107): '/test_snapshot_multinode_recover104' (connection.py:410, _read_response) 2026-04-29 22:47:30 [ 539 ] DEBUG : Sending request(xid=108): Create(path='/test_snapshot_multinode_recover105', data=b'somedata105', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:30 [ 539 ] DEBUG : Received response(xid=108): '/test_snapshot_multinode_recover105' (connection.py:410, _read_response) 2026-04-29 22:47:30 [ 539 ] DEBUG : Sending request(xid=109): Create(path='/test_snapshot_multinode_recover106', data=b'somedata106', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:30 [ 539 ] DEBUG : Received response(xid=109): '/test_snapshot_multinode_recover106' (connection.py:410, _read_response) 2026-04-29 22:47:30 [ 539 ] DEBUG : Sending request(xid=110): Create(path='/test_snapshot_multinode_recover107', data=b'somedata107', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:30 [ 539 ] DEBUG : Received response(xid=110): '/test_snapshot_multinode_recover107' (connection.py:410, _read_response) 2026-04-29 22:47:30 [ 539 ] DEBUG : Sending request(xid=111): Create(path='/test_snapshot_multinode_recover108', data=b'somedata108', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:30 [ 539 ] DEBUG : Received response(xid=111): '/test_snapshot_multinode_recover108' (connection.py:410, _read_response) 2026-04-29 22:47:30 [ 539 ] DEBUG : Sending request(xid=112): Create(path='/test_snapshot_multinode_recover109', data=b'somedata109', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:30 [ 539 ] DEBUG : Received response(xid=112): '/test_snapshot_multinode_recover109' (connection.py:410, _read_response) 2026-04-29 22:47:30 [ 539 ] DEBUG : Sending request(xid=113): Create(path='/test_snapshot_multinode_recover110', data=b'somedata110', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:30 [ 539 ] DEBUG : Received response(xid=113): '/test_snapshot_multinode_recover110' (connection.py:410, _read_response) 2026-04-29 22:47:30 [ 539 ] DEBUG : Sending request(xid=114): Create(path='/test_snapshot_multinode_recover111', data=b'somedata111', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:30 [ 539 ] DEBUG : Received response(xid=114): '/test_snapshot_multinode_recover111' (connection.py:410, _read_response) 2026-04-29 22:47:30 [ 539 ] DEBUG : Sending request(xid=115): Create(path='/test_snapshot_multinode_recover112', data=b'somedata112', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:30 [ 539 ] DEBUG : Received response(xid=115): '/test_snapshot_multinode_recover112' (connection.py:410, _read_response) 2026-04-29 22:47:30 [ 539 ] DEBUG : Sending request(xid=116): Create(path='/test_snapshot_multinode_recover113', data=b'somedata113', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:30 [ 539 ] DEBUG : Received response(xid=116): '/test_snapshot_multinode_recover113' (connection.py:410, _read_response) 2026-04-29 22:47:30 [ 539 ] DEBUG : Sending request(xid=117): Create(path='/test_snapshot_multinode_recover114', data=b'somedata114', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:30 [ 539 ] DEBUG : Received response(xid=117): '/test_snapshot_multinode_recover114' (connection.py:410, _read_response) 2026-04-29 22:47:30 [ 539 ] DEBUG : Sending request(xid=118): Create(path='/test_snapshot_multinode_recover115', data=b'somedata115', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:30 [ 539 ] DEBUG : Received response(xid=118): '/test_snapshot_multinode_recover115' (connection.py:410, _read_response) 2026-04-29 22:47:30 [ 539 ] DEBUG : Sending request(xid=119): Create(path='/test_snapshot_multinode_recover116', data=b'somedata116', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:30 [ 539 ] DEBUG : Received response(xid=119): '/test_snapshot_multinode_recover116' (connection.py:410, _read_response) 2026-04-29 22:47:30 [ 539 ] DEBUG : Sending request(xid=120): Create(path='/test_snapshot_multinode_recover117', data=b'somedata117', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:30 [ 539 ] INFO : Connecting to 172.16.25.3(172.16.25.3):9181, use_ssl: False (connection.py:650, _connect) 2026-04-29 22:47:30 [ 539 ] WARNING : Connection dropped: socket connection error: Connection refused (connection.py:622, _connect_attempt) 2026-04-29 22:47:30 [ 539 ] DEBUG : Received response(xid=120): '/test_snapshot_multinode_recover117' (connection.py:410, _read_response) 2026-04-29 22:47:30 [ 539 ] DEBUG : Sending request(xid=121): Create(path='/test_snapshot_multinode_recover118', data=b'somedata118', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:30 [ 539 ] DEBUG : Received response(xid=121): '/test_snapshot_multinode_recover118' (connection.py:410, _read_response) 2026-04-29 22:47:30 [ 539 ] DEBUG : Sending request(xid=122): Create(path='/test_snapshot_multinode_recover119', data=b'somedata119', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:31 [ 539 ] DEBUG : Received response(xid=122): '/test_snapshot_multinode_recover119' (connection.py:410, _read_response) 2026-04-29 22:47:31 [ 539 ] DEBUG : Sending request(xid=123): Create(path='/test_snapshot_multinode_recover120', data=b'somedata120', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:31 [ 539 ] DEBUG : Received response(xid=123): '/test_snapshot_multinode_recover120' (connection.py:410, _read_response) 2026-04-29 22:47:31 [ 539 ] DEBUG : Sending request(xid=124): Create(path='/test_snapshot_multinode_recover121', data=b'somedata121', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:31 [ 539 ] DEBUG : Received response(xid=124): '/test_snapshot_multinode_recover121' (connection.py:410, _read_response) 2026-04-29 22:47:31 [ 539 ] DEBUG : Sending request(xid=125): Create(path='/test_snapshot_multinode_recover122', data=b'somedata122', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:31 [ 539 ] DEBUG : Received response(xid=125): '/test_snapshot_multinode_recover122' (connection.py:410, _read_response) 2026-04-29 22:47:31 [ 539 ] DEBUG : Sending request(xid=126): Create(path='/test_snapshot_multinode_recover123', data=b'somedata123', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:31 [ 539 ] DEBUG : Received response(xid=126): '/test_snapshot_multinode_recover123' (connection.py:410, _read_response) 2026-04-29 22:47:31 [ 539 ] DEBUG : Sending request(xid=127): Create(path='/test_snapshot_multinode_recover124', data=b'somedata124', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:31 [ 539 ] DEBUG : Received response(xid=127): '/test_snapshot_multinode_recover124' (connection.py:410, _read_response) 2026-04-29 22:47:31 [ 539 ] DEBUG : Sending request(xid=128): Create(path='/test_snapshot_multinode_recover125', data=b'somedata125', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:31 [ 539 ] DEBUG : Received response(xid=128): '/test_snapshot_multinode_recover125' (connection.py:410, _read_response) 2026-04-29 22:47:31 [ 539 ] DEBUG : Sending request(xid=129): Create(path='/test_snapshot_multinode_recover126', data=b'somedata126', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:31 [ 539 ] DEBUG : Received response(xid=129): '/test_snapshot_multinode_recover126' (connection.py:410, _read_response) 2026-04-29 22:47:31 [ 539 ] DEBUG : Sending request(xid=130): Create(path='/test_snapshot_multinode_recover127', data=b'somedata127', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:31 [ 539 ] DEBUG : Received response(xid=130): '/test_snapshot_multinode_recover127' (connection.py:410, _read_response) 2026-04-29 22:47:31 [ 539 ] DEBUG : Sending request(xid=131): Create(path='/test_snapshot_multinode_recover128', data=b'somedata128', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:31 [ 539 ] DEBUG : Received response(xid=131): '/test_snapshot_multinode_recover128' (connection.py:410, _read_response) 2026-04-29 22:47:31 [ 539 ] DEBUG : Sending request(xid=132): Create(path='/test_snapshot_multinode_recover129', data=b'somedata129', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:31 [ 539 ] DEBUG : Received response(xid=132): '/test_snapshot_multinode_recover129' (connection.py:410, _read_response) 2026-04-29 22:47:31 [ 539 ] DEBUG : Sending request(xid=133): Create(path='/test_snapshot_multinode_recover130', data=b'somedata130', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:31 [ 539 ] DEBUG : Received response(xid=133): '/test_snapshot_multinode_recover130' (connection.py:410, _read_response) 2026-04-29 22:47:31 [ 539 ] DEBUG : Sending request(xid=134): Create(path='/test_snapshot_multinode_recover131', data=b'somedata131', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:31 [ 539 ] DEBUG : Received response(xid=134): '/test_snapshot_multinode_recover131' (connection.py:410, _read_response) 2026-04-29 22:47:31 [ 539 ] DEBUG : Sending request(xid=135): Create(path='/test_snapshot_multinode_recover132', data=b'somedata132', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:31 [ 539 ] DEBUG : Received response(xid=135): '/test_snapshot_multinode_recover132' (connection.py:410, _read_response) 2026-04-29 22:47:31 [ 539 ] DEBUG : Sending request(xid=136): Create(path='/test_snapshot_multinode_recover133', data=b'somedata133', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:31 [ 539 ] DEBUG : Received response(xid=136): '/test_snapshot_multinode_recover133' (connection.py:410, _read_response) 2026-04-29 22:47:31 [ 539 ] DEBUG : Sending request(xid=137): Create(path='/test_snapshot_multinode_recover134', data=b'somedata134', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:31 [ 539 ] DEBUG : Received response(xid=137): '/test_snapshot_multinode_recover134' (connection.py:410, _read_response) 2026-04-29 22:47:31 [ 539 ] DEBUG : Sending request(xid=138): Create(path='/test_snapshot_multinode_recover135', data=b'somedata135', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:31 [ 539 ] DEBUG : Received response(xid=138): '/test_snapshot_multinode_recover135' (connection.py:410, _read_response) 2026-04-29 22:47:31 [ 539 ] DEBUG : Sending request(xid=139): Create(path='/test_snapshot_multinode_recover136', data=b'somedata136', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:31 [ 539 ] DEBUG : Received response(xid=139): '/test_snapshot_multinode_recover136' (connection.py:410, _read_response) 2026-04-29 22:47:31 [ 539 ] DEBUG : Sending request(xid=140): Create(path='/test_snapshot_multinode_recover137', data=b'somedata137', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:31 [ 539 ] DEBUG : Received response(xid=140): '/test_snapshot_multinode_recover137' (connection.py:410, _read_response) 2026-04-29 22:47:31 [ 539 ] DEBUG : Sending request(xid=141): Create(path='/test_snapshot_multinode_recover138', data=b'somedata138', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:31 [ 539 ] DEBUG : Received response(xid=141): '/test_snapshot_multinode_recover138' (connection.py:410, _read_response) 2026-04-29 22:47:31 [ 539 ] DEBUG : Sending request(xid=142): Create(path='/test_snapshot_multinode_recover139', data=b'somedata139', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:31 [ 539 ] DEBUG : Received response(xid=142): '/test_snapshot_multinode_recover139' (connection.py:410, _read_response) 2026-04-29 22:47:31 [ 539 ] DEBUG : Sending request(xid=143): Create(path='/test_snapshot_multinode_recover140', data=b'somedata140', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:31 [ 539 ] DEBUG : Received response(xid=143): '/test_snapshot_multinode_recover140' (connection.py:410, _read_response) 2026-04-29 22:47:31 [ 539 ] DEBUG : Sending request(xid=144): Create(path='/test_snapshot_multinode_recover141', data=b'somedata141', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:31 [ 539 ] DEBUG : Received response(xid=144): '/test_snapshot_multinode_recover141' (connection.py:410, _read_response) 2026-04-29 22:47:31 [ 539 ] DEBUG : Sending request(xid=145): Create(path='/test_snapshot_multinode_recover142', data=b'somedata142', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:31 [ 539 ] DEBUG : Received response(xid=145): '/test_snapshot_multinode_recover142' (connection.py:410, _read_response) 2026-04-29 22:47:31 [ 539 ] DEBUG : Sending request(xid=146): Create(path='/test_snapshot_multinode_recover143', data=b'somedata143', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:31 [ 539 ] DEBUG : Received response(xid=146): '/test_snapshot_multinode_recover143' (connection.py:410, _read_response) 2026-04-29 22:47:31 [ 539 ] DEBUG : Sending request(xid=147): Create(path='/test_snapshot_multinode_recover144', data=b'somedata144', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:31 [ 539 ] DEBUG : Received response(xid=147): '/test_snapshot_multinode_recover144' (connection.py:410, _read_response) 2026-04-29 22:47:31 [ 539 ] DEBUG : Sending request(xid=148): Create(path='/test_snapshot_multinode_recover145', data=b'somedata145', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:31 [ 539 ] DEBUG : Received response(xid=148): '/test_snapshot_multinode_recover145' (connection.py:410, _read_response) 2026-04-29 22:47:31 [ 539 ] DEBUG : Sending request(xid=149): Create(path='/test_snapshot_multinode_recover146', data=b'somedata146', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:31 [ 539 ] DEBUG : Received response(xid=149): '/test_snapshot_multinode_recover146' (connection.py:410, _read_response) 2026-04-29 22:47:31 [ 539 ] DEBUG : Sending request(xid=150): Create(path='/test_snapshot_multinode_recover147', data=b'somedata147', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:31 [ 539 ] DEBUG : Received response(xid=150): '/test_snapshot_multinode_recover147' (connection.py:410, _read_response) 2026-04-29 22:47:31 [ 539 ] DEBUG : Sending request(xid=151): Create(path='/test_snapshot_multinode_recover148', data=b'somedata148', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:31 [ 539 ] DEBUG : Received response(xid=151): '/test_snapshot_multinode_recover148' (connection.py:410, _read_response) 2026-04-29 22:47:31 [ 539 ] DEBUG : Sending request(xid=152): Create(path='/test_snapshot_multinode_recover149', data=b'somedata149', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:31 [ 539 ] DEBUG : Received response(xid=152): '/test_snapshot_multinode_recover149' (connection.py:410, _read_response) 2026-04-29 22:47:31 [ 539 ] DEBUG : Sending request(xid=153): Create(path='/test_snapshot_multinode_recover150', data=b'somedata150', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:31 [ 539 ] DEBUG : Received response(xid=153): '/test_snapshot_multinode_recover150' (connection.py:410, _read_response) 2026-04-29 22:47:31 [ 539 ] DEBUG : Sending request(xid=154): Create(path='/test_snapshot_multinode_recover151', data=b'somedata151', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:31 [ 539 ] DEBUG : Received response(xid=154): '/test_snapshot_multinode_recover151' (connection.py:410, _read_response) 2026-04-29 22:47:31 [ 539 ] DEBUG : Sending request(xid=155): Create(path='/test_snapshot_multinode_recover152', data=b'somedata152', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:31 [ 539 ] DEBUG : Received response(xid=155): '/test_snapshot_multinode_recover152' (connection.py:410, _read_response) 2026-04-29 22:47:31 [ 539 ] DEBUG : Sending request(xid=156): Create(path='/test_snapshot_multinode_recover153', data=b'somedata153', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:31 [ 539 ] DEBUG : Received response(xid=156): '/test_snapshot_multinode_recover153' (connection.py:410, _read_response) 2026-04-29 22:47:31 [ 539 ] DEBUG : Sending request(xid=157): Create(path='/test_snapshot_multinode_recover154', data=b'somedata154', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:31 [ 539 ] DEBUG : Received response(xid=157): '/test_snapshot_multinode_recover154' (connection.py:410, _read_response) 2026-04-29 22:47:31 [ 539 ] DEBUG : Sending request(xid=158): Create(path='/test_snapshot_multinode_recover155', data=b'somedata155', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:31 [ 539 ] DEBUG : Received response(xid=158): '/test_snapshot_multinode_recover155' (connection.py:410, _read_response) 2026-04-29 22:47:31 [ 539 ] DEBUG : Sending request(xid=159): Create(path='/test_snapshot_multinode_recover156', data=b'somedata156', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:32 [ 539 ] DEBUG : Received response(xid=159): '/test_snapshot_multinode_recover156' (connection.py:410, _read_response) 2026-04-29 22:47:32 [ 539 ] DEBUG : Sending request(xid=160): Create(path='/test_snapshot_multinode_recover157', data=b'somedata157', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:32 [ 539 ] DEBUG : Received response(xid=160): '/test_snapshot_multinode_recover157' (connection.py:410, _read_response) 2026-04-29 22:47:32 [ 539 ] DEBUG : Sending request(xid=161): Create(path='/test_snapshot_multinode_recover158', data=b'somedata158', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:32 [ 539 ] DEBUG : Received response(xid=161): '/test_snapshot_multinode_recover158' (connection.py:410, _read_response) 2026-04-29 22:47:32 [ 539 ] DEBUG : Sending request(xid=162): Create(path='/test_snapshot_multinode_recover159', data=b'somedata159', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:32 [ 539 ] DEBUG : Received response(xid=162): '/test_snapshot_multinode_recover159' (connection.py:410, _read_response) 2026-04-29 22:47:32 [ 539 ] DEBUG : Sending request(xid=163): Create(path='/test_snapshot_multinode_recover160', data=b'somedata160', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:32 [ 539 ] DEBUG : Received response(xid=163): '/test_snapshot_multinode_recover160' (connection.py:410, _read_response) 2026-04-29 22:47:32 [ 539 ] DEBUG : Sending request(xid=164): Create(path='/test_snapshot_multinode_recover161', data=b'somedata161', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:32 [ 539 ] DEBUG : Received response(xid=164): '/test_snapshot_multinode_recover161' (connection.py:410, _read_response) 2026-04-29 22:47:32 [ 539 ] DEBUG : Sending request(xid=165): Create(path='/test_snapshot_multinode_recover162', data=b'somedata162', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:32 [ 539 ] DEBUG : Received response(xid=165): '/test_snapshot_multinode_recover162' (connection.py:410, _read_response) 2026-04-29 22:47:32 [ 539 ] DEBUG : Sending request(xid=166): Create(path='/test_snapshot_multinode_recover163', data=b'somedata163', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:32 [ 539 ] DEBUG : Received response(xid=166): '/test_snapshot_multinode_recover163' (connection.py:410, _read_response) 2026-04-29 22:47:32 [ 539 ] DEBUG : Sending request(xid=167): Create(path='/test_snapshot_multinode_recover164', data=b'somedata164', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:32 [ 539 ] DEBUG : Received response(xid=167): '/test_snapshot_multinode_recover164' (connection.py:410, _read_response) 2026-04-29 22:47:32 [ 539 ] DEBUG : Sending request(xid=168): Create(path='/test_snapshot_multinode_recover165', data=b'somedata165', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:32 [ 539 ] DEBUG : Received response(xid=168): '/test_snapshot_multinode_recover165' (connection.py:410, _read_response) 2026-04-29 22:47:32 [ 539 ] DEBUG : Sending request(xid=169): Create(path='/test_snapshot_multinode_recover166', data=b'somedata166', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:32 [ 539 ] DEBUG : Received response(xid=169): '/test_snapshot_multinode_recover166' (connection.py:410, _read_response) 2026-04-29 22:47:32 [ 539 ] DEBUG : Sending request(xid=170): Create(path='/test_snapshot_multinode_recover167', data=b'somedata167', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:32 [ 539 ] DEBUG : Received response(xid=170): '/test_snapshot_multinode_recover167' (connection.py:410, _read_response) 2026-04-29 22:47:32 [ 539 ] DEBUG : Sending request(xid=171): Create(path='/test_snapshot_multinode_recover168', data=b'somedata168', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:32 [ 539 ] DEBUG : Received response(xid=171): '/test_snapshot_multinode_recover168' (connection.py:410, _read_response) 2026-04-29 22:47:32 [ 539 ] DEBUG : Sending request(xid=172): Create(path='/test_snapshot_multinode_recover169', data=b'somedata169', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:32 [ 539 ] DEBUG : Received response(xid=172): '/test_snapshot_multinode_recover169' (connection.py:410, _read_response) 2026-04-29 22:47:32 [ 539 ] DEBUG : Sending request(xid=173): Create(path='/test_snapshot_multinode_recover170', data=b'somedata170', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:32 [ 539 ] DEBUG : Received response(xid=173): '/test_snapshot_multinode_recover170' (connection.py:410, _read_response) 2026-04-29 22:47:32 [ 539 ] DEBUG : Sending request(xid=174): Create(path='/test_snapshot_multinode_recover171', data=b'somedata171', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:32 [ 539 ] DEBUG : Received response(xid=174): '/test_snapshot_multinode_recover171' (connection.py:410, _read_response) 2026-04-29 22:47:32 [ 539 ] DEBUG : Sending request(xid=175): Create(path='/test_snapshot_multinode_recover172', data=b'somedata172', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:32 [ 539 ] DEBUG : Received response(xid=175): '/test_snapshot_multinode_recover172' (connection.py:410, _read_response) 2026-04-29 22:47:32 [ 539 ] DEBUG : Sending request(xid=176): Create(path='/test_snapshot_multinode_recover173', data=b'somedata173', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:32 [ 539 ] DEBUG : Received response(xid=176): '/test_snapshot_multinode_recover173' (connection.py:410, _read_response) 2026-04-29 22:47:32 [ 539 ] DEBUG : Sending request(xid=177): Create(path='/test_snapshot_multinode_recover174', data=b'somedata174', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:32 [ 539 ] DEBUG : Received response(xid=177): '/test_snapshot_multinode_recover174' (connection.py:410, _read_response) 2026-04-29 22:47:32 [ 539 ] DEBUG : Sending request(xid=178): Create(path='/test_snapshot_multinode_recover175', data=b'somedata175', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:32 [ 539 ] DEBUG : Received response(xid=178): '/test_snapshot_multinode_recover175' (connection.py:410, _read_response) 2026-04-29 22:47:32 [ 539 ] DEBUG : Sending request(xid=179): Create(path='/test_snapshot_multinode_recover176', data=b'somedata176', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:32 [ 539 ] DEBUG : Received response(xid=179): '/test_snapshot_multinode_recover176' (connection.py:410, _read_response) 2026-04-29 22:47:32 [ 539 ] DEBUG : Sending request(xid=180): Create(path='/test_snapshot_multinode_recover177', data=b'somedata177', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:32 [ 539 ] DEBUG : Received response(xid=180): '/test_snapshot_multinode_recover177' (connection.py:410, _read_response) 2026-04-29 22:47:32 [ 539 ] DEBUG : Sending request(xid=181): Create(path='/test_snapshot_multinode_recover178', data=b'somedata178', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:32 [ 539 ] DEBUG : Received response(xid=181): '/test_snapshot_multinode_recover178' (connection.py:410, _read_response) 2026-04-29 22:47:32 [ 539 ] DEBUG : Sending request(xid=182): Create(path='/test_snapshot_multinode_recover179', data=b'somedata179', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:32 [ 539 ] DEBUG : Received response(xid=182): '/test_snapshot_multinode_recover179' (connection.py:410, _read_response) 2026-04-29 22:47:32 [ 539 ] DEBUG : Sending request(xid=183): Create(path='/test_snapshot_multinode_recover180', data=b'somedata180', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:32 [ 539 ] DEBUG : Received response(xid=183): '/test_snapshot_multinode_recover180' (connection.py:410, _read_response) 2026-04-29 22:47:32 [ 539 ] DEBUG : Sending request(xid=184): Create(path='/test_snapshot_multinode_recover181', data=b'somedata181', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:32 [ 539 ] DEBUG : Received response(xid=184): '/test_snapshot_multinode_recover181' (connection.py:410, _read_response) 2026-04-29 22:47:32 [ 539 ] DEBUG : Sending request(xid=185): Create(path='/test_snapshot_multinode_recover182', data=b'somedata182', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:32 [ 539 ] DEBUG : Received response(xid=185): '/test_snapshot_multinode_recover182' (connection.py:410, _read_response) 2026-04-29 22:47:32 [ 539 ] DEBUG : Sending request(xid=186): Create(path='/test_snapshot_multinode_recover183', data=b'somedata183', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:32 [ 539 ] DEBUG : Received response(xid=186): '/test_snapshot_multinode_recover183' (connection.py:410, _read_response) 2026-04-29 22:47:32 [ 539 ] DEBUG : Sending request(xid=187): Create(path='/test_snapshot_multinode_recover184', data=b'somedata184', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:32 [ 539 ] DEBUG : Received response(xid=187): '/test_snapshot_multinode_recover184' (connection.py:410, _read_response) 2026-04-29 22:47:32 [ 539 ] DEBUG : Sending request(xid=188): Create(path='/test_snapshot_multinode_recover185', data=b'somedata185', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:32 [ 539 ] INFO : Connecting to 172.16.25.3(172.16.25.3):9181, use_ssl: False (connection.py:650, _connect) 2026-04-29 22:47:32 [ 539 ] WARNING : Connection dropped: socket connection error: Connection refused (connection.py:622, _connect_attempt) 2026-04-29 22:47:32 [ 539 ] DEBUG : Received response(xid=188): '/test_snapshot_multinode_recover185' (connection.py:410, _read_response) 2026-04-29 22:47:32 [ 539 ] DEBUG : Sending request(xid=189): Create(path='/test_snapshot_multinode_recover186', data=b'somedata186', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:32 [ 539 ] DEBUG : Received response(xid=189): '/test_snapshot_multinode_recover186' (connection.py:410, _read_response) 2026-04-29 22:47:32 [ 539 ] DEBUG : Sending request(xid=190): Create(path='/test_snapshot_multinode_recover187', data=b'somedata187', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:32 [ 539 ] DEBUG : Received response(xid=190): '/test_snapshot_multinode_recover187' (connection.py:410, _read_response) 2026-04-29 22:47:32 [ 539 ] DEBUG : Sending request(xid=191): Create(path='/test_snapshot_multinode_recover188', data=b'somedata188', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:32 [ 539 ] DEBUG : Received response(xid=191): '/test_snapshot_multinode_recover188' (connection.py:410, _read_response) 2026-04-29 22:47:32 [ 539 ] DEBUG : Sending request(xid=192): Create(path='/test_snapshot_multinode_recover189', data=b'somedata189', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:33 [ 539 ] DEBUG : Received response(xid=192): '/test_snapshot_multinode_recover189' (connection.py:410, _read_response) 2026-04-29 22:47:33 [ 539 ] DEBUG : Sending request(xid=193): Create(path='/test_snapshot_multinode_recover190', data=b'somedata190', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:33 [ 539 ] DEBUG : Received response(xid=193): '/test_snapshot_multinode_recover190' (connection.py:410, _read_response) 2026-04-29 22:47:33 [ 539 ] DEBUG : Sending request(xid=194): Create(path='/test_snapshot_multinode_recover191', data=b'somedata191', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:33 [ 539 ] DEBUG : Received response(xid=194): '/test_snapshot_multinode_recover191' (connection.py:410, _read_response) 2026-04-29 22:47:33 [ 539 ] DEBUG : Sending request(xid=195): Create(path='/test_snapshot_multinode_recover192', data=b'somedata192', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:33 [ 539 ] DEBUG : Received response(xid=195): '/test_snapshot_multinode_recover192' (connection.py:410, _read_response) 2026-04-29 22:47:33 [ 539 ] DEBUG : Sending request(xid=196): Create(path='/test_snapshot_multinode_recover193', data=b'somedata193', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:33 [ 539 ] DEBUG : Received response(xid=196): '/test_snapshot_multinode_recover193' (connection.py:410, _read_response) 2026-04-29 22:47:33 [ 539 ] DEBUG : Sending request(xid=197): Create(path='/test_snapshot_multinode_recover194', data=b'somedata194', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:33 [ 539 ] DEBUG : Received response(xid=197): '/test_snapshot_multinode_recover194' (connection.py:410, _read_response) 2026-04-29 22:47:33 [ 539 ] DEBUG : Sending request(xid=198): Create(path='/test_snapshot_multinode_recover195', data=b'somedata195', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:33 [ 539 ] DEBUG : Received response(xid=198): '/test_snapshot_multinode_recover195' (connection.py:410, _read_response) 2026-04-29 22:47:33 [ 539 ] DEBUG : Sending request(xid=199): Create(path='/test_snapshot_multinode_recover196', data=b'somedata196', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:33 [ 539 ] DEBUG : Received response(xid=199): '/test_snapshot_multinode_recover196' (connection.py:410, _read_response) 2026-04-29 22:47:33 [ 539 ] DEBUG : Sending request(xid=200): Create(path='/test_snapshot_multinode_recover197', data=b'somedata197', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:33 [ 539 ] DEBUG : Received response(xid=200): '/test_snapshot_multinode_recover197' (connection.py:410, _read_response) 2026-04-29 22:47:33 [ 539 ] DEBUG : Sending request(xid=201): Create(path='/test_snapshot_multinode_recover198', data=b'somedata198', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:33 [ 539 ] DEBUG : Received response(xid=201): '/test_snapshot_multinode_recover198' (connection.py:410, _read_response) 2026-04-29 22:47:33 [ 539 ] DEBUG : Sending request(xid=202): Create(path='/test_snapshot_multinode_recover199', data=b'somedata199', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:33 [ 539 ] DEBUG : Received response(xid=202): '/test_snapshot_multinode_recover199' (connection.py:410, _read_response) 2026-04-29 22:47:33 [ 539 ] DEBUG : Sending request(xid=203): Create(path='/test_snapshot_multinode_recover200', data=b'somedata200', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:33 [ 539 ] DEBUG : Received response(xid=203): '/test_snapshot_multinode_recover200' (connection.py:410, _read_response) 2026-04-29 22:47:33 [ 539 ] DEBUG : Sending request(xid=204): Create(path='/test_snapshot_multinode_recover201', data=b'somedata201', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:33 [ 539 ] DEBUG : Received response(xid=204): '/test_snapshot_multinode_recover201' (connection.py:410, _read_response) 2026-04-29 22:47:33 [ 539 ] DEBUG : Sending request(xid=205): Create(path='/test_snapshot_multinode_recover202', data=b'somedata202', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:33 [ 539 ] DEBUG : Received response(xid=205): '/test_snapshot_multinode_recover202' (connection.py:410, _read_response) 2026-04-29 22:47:33 [ 539 ] DEBUG : Sending request(xid=206): Create(path='/test_snapshot_multinode_recover203', data=b'somedata203', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:33 [ 539 ] DEBUG : Received response(xid=206): '/test_snapshot_multinode_recover203' (connection.py:410, _read_response) 2026-04-29 22:47:33 [ 539 ] DEBUG : Sending request(xid=207): Create(path='/test_snapshot_multinode_recover204', data=b'somedata204', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:33 [ 539 ] DEBUG : Received response(xid=207): '/test_snapshot_multinode_recover204' (connection.py:410, _read_response) 2026-04-29 22:47:33 [ 539 ] DEBUG : Sending request(xid=208): Create(path='/test_snapshot_multinode_recover205', data=b'somedata205', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:33 [ 539 ] DEBUG : Received response(xid=208): '/test_snapshot_multinode_recover205' (connection.py:410, _read_response) 2026-04-29 22:47:33 [ 539 ] DEBUG : Sending request(xid=209): Create(path='/test_snapshot_multinode_recover206', data=b'somedata206', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:33 [ 539 ] DEBUG : Received response(xid=209): '/test_snapshot_multinode_recover206' (connection.py:410, _read_response) 2026-04-29 22:47:33 [ 539 ] DEBUG : Sending request(xid=210): Create(path='/test_snapshot_multinode_recover207', data=b'somedata207', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:33 [ 539 ] DEBUG : Received response(xid=210): '/test_snapshot_multinode_recover207' (connection.py:410, _read_response) 2026-04-29 22:47:33 [ 539 ] DEBUG : Sending request(xid=211): Create(path='/test_snapshot_multinode_recover208', data=b'somedata208', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:33 [ 539 ] DEBUG : Received response(xid=211): '/test_snapshot_multinode_recover208' (connection.py:410, _read_response) 2026-04-29 22:47:33 [ 539 ] DEBUG : Sending request(xid=212): Create(path='/test_snapshot_multinode_recover209', data=b'somedata209', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:33 [ 539 ] DEBUG : Received response(xid=212): '/test_snapshot_multinode_recover209' (connection.py:410, _read_response) 2026-04-29 22:47:33 [ 539 ] DEBUG : Sending request(xid=213): Create(path='/test_snapshot_multinode_recover210', data=b'somedata210', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:33 [ 539 ] DEBUG : Received response(xid=213): '/test_snapshot_multinode_recover210' (connection.py:410, _read_response) 2026-04-29 22:47:33 [ 539 ] DEBUG : Sending request(xid=214): Create(path='/test_snapshot_multinode_recover211', data=b'somedata211', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:33 [ 539 ] DEBUG : Received response(xid=214): '/test_snapshot_multinode_recover211' (connection.py:410, _read_response) 2026-04-29 22:47:33 [ 539 ] DEBUG : Sending request(xid=215): Create(path='/test_snapshot_multinode_recover212', data=b'somedata212', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:33 [ 539 ] DEBUG : Received response(xid=215): '/test_snapshot_multinode_recover212' (connection.py:410, _read_response) 2026-04-29 22:47:33 [ 539 ] DEBUG : Sending request(xid=216): Create(path='/test_snapshot_multinode_recover213', data=b'somedata213', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:33 [ 539 ] DEBUG : Received response(xid=216): '/test_snapshot_multinode_recover213' (connection.py:410, _read_response) 2026-04-29 22:47:33 [ 539 ] DEBUG : Sending request(xid=217): Create(path='/test_snapshot_multinode_recover214', data=b'somedata214', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:33 [ 539 ] DEBUG : Received response(xid=217): '/test_snapshot_multinode_recover214' (connection.py:410, _read_response) 2026-04-29 22:47:33 [ 539 ] DEBUG : Sending request(xid=218): Create(path='/test_snapshot_multinode_recover215', data=b'somedata215', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:33 [ 539 ] DEBUG : Received response(xid=218): '/test_snapshot_multinode_recover215' (connection.py:410, _read_response) 2026-04-29 22:47:33 [ 539 ] DEBUG : Sending request(xid=219): Create(path='/test_snapshot_multinode_recover216', data=b'somedata216', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:33 [ 539 ] DEBUG : Received response(xid=219): '/test_snapshot_multinode_recover216' (connection.py:410, _read_response) 2026-04-29 22:47:33 [ 539 ] DEBUG : Sending request(xid=220): Create(path='/test_snapshot_multinode_recover217', data=b'somedata217', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:33 [ 539 ] DEBUG : Received response(xid=220): '/test_snapshot_multinode_recover217' (connection.py:410, _read_response) 2026-04-29 22:47:33 [ 539 ] DEBUG : Sending request(xid=221): Create(path='/test_snapshot_multinode_recover218', data=b'somedata218', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:33 [ 539 ] DEBUG : Received response(xid=221): '/test_snapshot_multinode_recover218' (connection.py:410, _read_response) 2026-04-29 22:47:33 [ 539 ] DEBUG : Sending request(xid=222): Create(path='/test_snapshot_multinode_recover219', data=b'somedata219', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:33 [ 539 ] DEBUG : Received response(xid=222): '/test_snapshot_multinode_recover219' (connection.py:410, _read_response) 2026-04-29 22:47:33 [ 539 ] DEBUG : Sending request(xid=223): Create(path='/test_snapshot_multinode_recover220', data=b'somedata220', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:33 [ 539 ] DEBUG : Received response(xid=223): '/test_snapshot_multinode_recover220' (connection.py:410, _read_response) 2026-04-29 22:47:33 [ 539 ] DEBUG : Sending request(xid=224): Create(path='/test_snapshot_multinode_recover221', data=b'somedata221', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:33 [ 539 ] DEBUG : Received response(xid=224): '/test_snapshot_multinode_recover221' (connection.py:410, _read_response) 2026-04-29 22:47:33 [ 539 ] DEBUG : Sending request(xid=225): Create(path='/test_snapshot_multinode_recover222', data=b'somedata222', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:33 [ 539 ] DEBUG : Received response(xid=225): '/test_snapshot_multinode_recover222' (connection.py:410, _read_response) 2026-04-29 22:47:33 [ 539 ] DEBUG : Sending request(xid=226): Create(path='/test_snapshot_multinode_recover223', data=b'somedata223', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:33 [ 539 ] DEBUG : Received response(xid=226): '/test_snapshot_multinode_recover223' (connection.py:410, _read_response) 2026-04-29 22:47:33 [ 539 ] DEBUG : Sending request(xid=227): Create(path='/test_snapshot_multinode_recover224', data=b'somedata224', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:33 [ 539 ] DEBUG : Received response(xid=227): '/test_snapshot_multinode_recover224' (connection.py:410, _read_response) 2026-04-29 22:47:33 [ 539 ] DEBUG : Sending request(xid=228): Create(path='/test_snapshot_multinode_recover225', data=b'somedata225', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:33 [ 539 ] DEBUG : Received response(xid=228): '/test_snapshot_multinode_recover225' (connection.py:410, _read_response) 2026-04-29 22:47:33 [ 539 ] DEBUG : Sending request(xid=229): Create(path='/test_snapshot_multinode_recover226', data=b'somedata226', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:33 [ 539 ] DEBUG : Received response(xid=229): '/test_snapshot_multinode_recover226' (connection.py:410, _read_response) 2026-04-29 22:47:33 [ 539 ] DEBUG : Sending request(xid=230): Create(path='/test_snapshot_multinode_recover227', data=b'somedata227', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:33 [ 539 ] DEBUG : Received response(xid=230): '/test_snapshot_multinode_recover227' (connection.py:410, _read_response) 2026-04-29 22:47:33 [ 539 ] DEBUG : Sending request(xid=231): Create(path='/test_snapshot_multinode_recover228', data=b'somedata228', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:33 [ 539 ] DEBUG : Received response(xid=231): '/test_snapshot_multinode_recover228' (connection.py:410, _read_response) 2026-04-29 22:47:33 [ 539 ] DEBUG : Sending request(xid=232): Create(path='/test_snapshot_multinode_recover229', data=b'somedata229', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:34 [ 539 ] DEBUG : Received response(xid=232): '/test_snapshot_multinode_recover229' (connection.py:410, _read_response) 2026-04-29 22:47:34 [ 539 ] DEBUG : Sending request(xid=233): Create(path='/test_snapshot_multinode_recover230', data=b'somedata230', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:34 [ 539 ] DEBUG : Received response(xid=233): '/test_snapshot_multinode_recover230' (connection.py:410, _read_response) 2026-04-29 22:47:34 [ 539 ] DEBUG : Sending request(xid=234): Create(path='/test_snapshot_multinode_recover231', data=b'somedata231', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:34 [ 539 ] DEBUG : Received response(xid=234): '/test_snapshot_multinode_recover231' (connection.py:410, _read_response) 2026-04-29 22:47:34 [ 539 ] DEBUG : Sending request(xid=235): Create(path='/test_snapshot_multinode_recover232', data=b'somedata232', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:34 [ 539 ] DEBUG : Received response(xid=235): '/test_snapshot_multinode_recover232' (connection.py:410, _read_response) 2026-04-29 22:47:34 [ 539 ] DEBUG : Sending request(xid=236): Create(path='/test_snapshot_multinode_recover233', data=b'somedata233', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:34 [ 539 ] DEBUG : Received response(xid=236): '/test_snapshot_multinode_recover233' (connection.py:410, _read_response) 2026-04-29 22:47:34 [ 539 ] DEBUG : Sending request(xid=237): Create(path='/test_snapshot_multinode_recover234', data=b'somedata234', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:34 [ 539 ] DEBUG : Received response(xid=237): '/test_snapshot_multinode_recover234' (connection.py:410, _read_response) 2026-04-29 22:47:34 [ 539 ] DEBUG : Sending request(xid=238): Create(path='/test_snapshot_multinode_recover235', data=b'somedata235', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:34 [ 539 ] DEBUG : Received response(xid=238): '/test_snapshot_multinode_recover235' (connection.py:410, _read_response) 2026-04-29 22:47:34 [ 539 ] DEBUG : Sending request(xid=239): Create(path='/test_snapshot_multinode_recover236', data=b'somedata236', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:34 [ 539 ] DEBUG : Received response(xid=239): '/test_snapshot_multinode_recover236' (connection.py:410, _read_response) 2026-04-29 22:47:34 [ 539 ] DEBUG : Sending request(xid=240): Create(path='/test_snapshot_multinode_recover237', data=b'somedata237', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:34 [ 539 ] DEBUG : Received response(xid=240): '/test_snapshot_multinode_recover237' (connection.py:410, _read_response) 2026-04-29 22:47:34 [ 539 ] DEBUG : Sending request(xid=241): Create(path='/test_snapshot_multinode_recover238', data=b'somedata238', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:34 [ 539 ] DEBUG : Received response(xid=241): '/test_snapshot_multinode_recover238' (connection.py:410, _read_response) 2026-04-29 22:47:34 [ 539 ] DEBUG : Sending request(xid=242): Create(path='/test_snapshot_multinode_recover239', data=b'somedata239', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:34 [ 539 ] DEBUG : Received response(xid=242): '/test_snapshot_multinode_recover239' (connection.py:410, _read_response) 2026-04-29 22:47:34 [ 539 ] DEBUG : Sending request(xid=243): Create(path='/test_snapshot_multinode_recover240', data=b'somedata240', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:34 [ 539 ] DEBUG : Received response(xid=243): '/test_snapshot_multinode_recover240' (connection.py:410, _read_response) 2026-04-29 22:47:34 [ 539 ] DEBUG : Sending request(xid=244): Create(path='/test_snapshot_multinode_recover241', data=b'somedata241', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:34 [ 539 ] DEBUG : Received response(xid=244): '/test_snapshot_multinode_recover241' (connection.py:410, _read_response) 2026-04-29 22:47:34 [ 539 ] DEBUG : Sending request(xid=245): Create(path='/test_snapshot_multinode_recover242', data=b'somedata242', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:34 [ 539 ] DEBUG : Received response(xid=245): '/test_snapshot_multinode_recover242' (connection.py:410, _read_response) 2026-04-29 22:47:34 [ 539 ] DEBUG : Sending request(xid=246): Create(path='/test_snapshot_multinode_recover243', data=b'somedata243', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:34 [ 539 ] DEBUG : Received response(xid=246): '/test_snapshot_multinode_recover243' (connection.py:410, _read_response) 2026-04-29 22:47:34 [ 539 ] DEBUG : Sending request(xid=247): Create(path='/test_snapshot_multinode_recover244', data=b'somedata244', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:34 [ 539 ] DEBUG : Received response(xid=247): '/test_snapshot_multinode_recover244' (connection.py:410, _read_response) 2026-04-29 22:47:34 [ 539 ] DEBUG : Sending request(xid=248): Create(path='/test_snapshot_multinode_recover245', data=b'somedata245', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:34 [ 539 ] DEBUG : Received response(xid=248): '/test_snapshot_multinode_recover245' (connection.py:410, _read_response) 2026-04-29 22:47:34 [ 539 ] DEBUG : Sending request(xid=249): Create(path='/test_snapshot_multinode_recover246', data=b'somedata246', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:34 [ 539 ] DEBUG : Received response(xid=249): '/test_snapshot_multinode_recover246' (connection.py:410, _read_response) 2026-04-29 22:47:34 [ 539 ] DEBUG : Sending request(xid=250): Create(path='/test_snapshot_multinode_recover247', data=b'somedata247', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:34 [ 539 ] DEBUG : Received response(xid=250): '/test_snapshot_multinode_recover247' (connection.py:410, _read_response) 2026-04-29 22:47:34 [ 539 ] DEBUG : Sending request(xid=251): Create(path='/test_snapshot_multinode_recover248', data=b'somedata248', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:34 [ 539 ] DEBUG : Received response(xid=251): '/test_snapshot_multinode_recover248' (connection.py:410, _read_response) 2026-04-29 22:47:34 [ 539 ] DEBUG : Sending request(xid=252): Create(path='/test_snapshot_multinode_recover249', data=b'somedata249', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:34 [ 539 ] DEBUG : Received response(xid=252): '/test_snapshot_multinode_recover249' (connection.py:410, _read_response) 2026-04-29 22:47:34 [ 539 ] DEBUG : Sending request(xid=253): Create(path='/test_snapshot_multinode_recover250', data=b'somedata250', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:34 [ 539 ] DEBUG : Received response(xid=253): '/test_snapshot_multinode_recover250' (connection.py:410, _read_response) 2026-04-29 22:47:34 [ 539 ] DEBUG : Sending request(xid=254): Create(path='/test_snapshot_multinode_recover251', data=b'somedata251', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:34 [ 539 ] DEBUG : Received response(xid=254): '/test_snapshot_multinode_recover251' (connection.py:410, _read_response) 2026-04-29 22:47:34 [ 539 ] DEBUG : Sending request(xid=255): Create(path='/test_snapshot_multinode_recover252', data=b'somedata252', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:34 [ 539 ] DEBUG : Received response(xid=255): '/test_snapshot_multinode_recover252' (connection.py:410, _read_response) 2026-04-29 22:47:34 [ 539 ] DEBUG : Sending request(xid=256): Create(path='/test_snapshot_multinode_recover253', data=b'somedata253', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:34 [ 539 ] DEBUG : Received response(xid=256): '/test_snapshot_multinode_recover253' (connection.py:410, _read_response) 2026-04-29 22:47:34 [ 539 ] DEBUG : Sending request(xid=257): Create(path='/test_snapshot_multinode_recover254', data=b'somedata254', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:34 [ 539 ] DEBUG : Received response(xid=257): '/test_snapshot_multinode_recover254' (connection.py:410, _read_response) 2026-04-29 22:47:34 [ 539 ] DEBUG : Sending request(xid=258): Create(path='/test_snapshot_multinode_recover255', data=b'somedata255', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:34 [ 539 ] DEBUG : Received response(xid=258): '/test_snapshot_multinode_recover255' (connection.py:410, _read_response) 2026-04-29 22:47:34 [ 539 ] DEBUG : Sending request(xid=259): Create(path='/test_snapshot_multinode_recover256', data=b'somedata256', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:34 [ 539 ] DEBUG : Received response(xid=259): '/test_snapshot_multinode_recover256' (connection.py:410, _read_response) 2026-04-29 22:47:34 [ 539 ] DEBUG : Sending request(xid=260): Create(path='/test_snapshot_multinode_recover257', data=b'somedata257', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:34 [ 539 ] DEBUG : Received response(xid=260): '/test_snapshot_multinode_recover257' (connection.py:410, _read_response) 2026-04-29 22:47:34 [ 539 ] DEBUG : Sending request(xid=261): Create(path='/test_snapshot_multinode_recover258', data=b'somedata258', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:34 [ 539 ] DEBUG : Received response(xid=261): '/test_snapshot_multinode_recover258' (connection.py:410, _read_response) 2026-04-29 22:47:34 [ 539 ] DEBUG : Sending request(xid=262): Create(path='/test_snapshot_multinode_recover259', data=b'somedata259', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:34 [ 539 ] DEBUG : Received response(xid=262): '/test_snapshot_multinode_recover259' (connection.py:410, _read_response) 2026-04-29 22:47:34 [ 539 ] DEBUG : Sending request(xid=263): Create(path='/test_snapshot_multinode_recover260', data=b'somedata260', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:34 [ 539 ] DEBUG : Received response(xid=263): '/test_snapshot_multinode_recover260' (connection.py:410, _read_response) 2026-04-29 22:47:34 [ 539 ] DEBUG : Sending request(xid=264): Create(path='/test_snapshot_multinode_recover261', data=b'somedata261', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:34 [ 539 ] DEBUG : Received response(xid=264): '/test_snapshot_multinode_recover261' (connection.py:410, _read_response) 2026-04-29 22:47:34 [ 539 ] DEBUG : Sending request(xid=265): Create(path='/test_snapshot_multinode_recover262', data=b'somedata262', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:34 [ 539 ] DEBUG : Received response(xid=265): '/test_snapshot_multinode_recover262' (connection.py:410, _read_response) 2026-04-29 22:47:34 [ 539 ] DEBUG : Sending request(xid=266): Create(path='/test_snapshot_multinode_recover263', data=b'somedata263', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:34 [ 539 ] DEBUG : Received response(xid=266): '/test_snapshot_multinode_recover263' (connection.py:410, _read_response) 2026-04-29 22:47:34 [ 539 ] DEBUG : Sending request(xid=267): Create(path='/test_snapshot_multinode_recover264', data=b'somedata264', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:34 [ 539 ] DEBUG : Received response(xid=267): '/test_snapshot_multinode_recover264' (connection.py:410, _read_response) 2026-04-29 22:47:34 [ 539 ] DEBUG : Sending request(xid=268): Create(path='/test_snapshot_multinode_recover265', data=b'somedata265', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:34 [ 539 ] DEBUG : Received response(xid=268): '/test_snapshot_multinode_recover265' (connection.py:410, _read_response) 2026-04-29 22:47:34 [ 539 ] DEBUG : Sending request(xid=269): Create(path='/test_snapshot_multinode_recover266', data=b'somedata266', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:34 [ 539 ] DEBUG : Received response(xid=269): '/test_snapshot_multinode_recover266' (connection.py:410, _read_response) 2026-04-29 22:47:34 [ 539 ] DEBUG : Sending request(xid=270): Create(path='/test_snapshot_multinode_recover267', data=b'somedata267', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:34 [ 539 ] DEBUG : Received response(xid=270): '/test_snapshot_multinode_recover267' (connection.py:410, _read_response) 2026-04-29 22:47:34 [ 539 ] DEBUG : Sending request(xid=271): Create(path='/test_snapshot_multinode_recover268', data=b'somedata268', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:34 [ 539 ] DEBUG : Received response(xid=271): '/test_snapshot_multinode_recover268' (connection.py:410, _read_response) 2026-04-29 22:47:34 [ 539 ] DEBUG : Sending request(xid=272): Create(path='/test_snapshot_multinode_recover269', data=b'somedata269', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:35 [ 539 ] DEBUG : Received response(xid=272): '/test_snapshot_multinode_recover269' (connection.py:410, _read_response) 2026-04-29 22:47:35 [ 539 ] DEBUG : Sending request(xid=273): Create(path='/test_snapshot_multinode_recover270', data=b'somedata270', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:35 [ 539 ] DEBUG : Received response(xid=273): '/test_snapshot_multinode_recover270' (connection.py:410, _read_response) 2026-04-29 22:47:35 [ 539 ] DEBUG : Sending request(xid=274): Create(path='/test_snapshot_multinode_recover271', data=b'somedata271', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:35 [ 539 ] DEBUG : Received response(xid=274): '/test_snapshot_multinode_recover271' (connection.py:410, _read_response) 2026-04-29 22:47:35 [ 539 ] DEBUG : Sending request(xid=275): Create(path='/test_snapshot_multinode_recover272', data=b'somedata272', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:35 [ 539 ] DEBUG : Received response(xid=275): '/test_snapshot_multinode_recover272' (connection.py:410, _read_response) 2026-04-29 22:47:35 [ 539 ] INFO : Connecting to 172.16.25.3(172.16.25.3):9181, use_ssl: False (connection.py:650, _connect) 2026-04-29 22:47:35 [ 539 ] WARNING : Connection dropped: socket connection error: Connection refused (connection.py:622, _connect_attempt) 2026-04-29 22:47:35 [ 539 ] DEBUG : Sending request(xid=276): Create(path='/test_snapshot_multinode_recover273', data=b'somedata273', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:35 [ 539 ] DEBUG : Received response(xid=276): '/test_snapshot_multinode_recover273' (connection.py:410, _read_response) 2026-04-29 22:47:35 [ 539 ] DEBUG : Sending request(xid=277): Create(path='/test_snapshot_multinode_recover274', data=b'somedata274', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:35 [ 539 ] DEBUG : Received response(xid=277): '/test_snapshot_multinode_recover274' (connection.py:410, _read_response) 2026-04-29 22:47:35 [ 539 ] DEBUG : Sending request(xid=278): Create(path='/test_snapshot_multinode_recover275', data=b'somedata275', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:35 [ 539 ] DEBUG : Received response(xid=278): '/test_snapshot_multinode_recover275' (connection.py:410, _read_response) 2026-04-29 22:47:35 [ 539 ] DEBUG : Sending request(xid=279): Create(path='/test_snapshot_multinode_recover276', data=b'somedata276', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:35 [ 539 ] DEBUG : Received response(xid=279): '/test_snapshot_multinode_recover276' (connection.py:410, _read_response) 2026-04-29 22:47:35 [ 539 ] DEBUG : Sending request(xid=280): Create(path='/test_snapshot_multinode_recover277', data=b'somedata277', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:35 [ 539 ] DEBUG : Received response(xid=280): '/test_snapshot_multinode_recover277' (connection.py:410, _read_response) 2026-04-29 22:47:35 [ 539 ] DEBUG : Sending request(xid=281): Create(path='/test_snapshot_multinode_recover278', data=b'somedata278', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:35 [ 539 ] DEBUG : Received response(xid=281): '/test_snapshot_multinode_recover278' (connection.py:410, _read_response) 2026-04-29 22:47:35 [ 539 ] DEBUG : Sending request(xid=282): Create(path='/test_snapshot_multinode_recover279', data=b'somedata279', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:35 [ 539 ] DEBUG : Received response(xid=282): '/test_snapshot_multinode_recover279' (connection.py:410, _read_response) 2026-04-29 22:47:35 [ 539 ] DEBUG : Sending request(xid=283): Create(path='/test_snapshot_multinode_recover280', data=b'somedata280', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:35 [ 539 ] DEBUG : Received response(xid=283): '/test_snapshot_multinode_recover280' (connection.py:410, _read_response) 2026-04-29 22:47:35 [ 539 ] DEBUG : Sending request(xid=284): Create(path='/test_snapshot_multinode_recover281', data=b'somedata281', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:35 [ 539 ] DEBUG : Received response(xid=284): '/test_snapshot_multinode_recover281' (connection.py:410, _read_response) 2026-04-29 22:47:35 [ 539 ] DEBUG : Sending request(xid=285): Create(path='/test_snapshot_multinode_recover282', data=b'somedata282', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:35 [ 539 ] DEBUG : Received response(xid=285): '/test_snapshot_multinode_recover282' (connection.py:410, _read_response) 2026-04-29 22:47:35 [ 539 ] DEBUG : Sending request(xid=286): Create(path='/test_snapshot_multinode_recover283', data=b'somedata283', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:35 [ 539 ] DEBUG : Received response(xid=286): '/test_snapshot_multinode_recover283' (connection.py:410, _read_response) 2026-04-29 22:47:35 [ 539 ] DEBUG : Sending request(xid=287): Create(path='/test_snapshot_multinode_recover284', data=b'somedata284', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:35 [ 539 ] DEBUG : Received response(xid=287): '/test_snapshot_multinode_recover284' (connection.py:410, _read_response) 2026-04-29 22:47:35 [ 539 ] DEBUG : Sending request(xid=288): Create(path='/test_snapshot_multinode_recover285', data=b'somedata285', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:35 [ 539 ] DEBUG : Received response(xid=288): '/test_snapshot_multinode_recover285' (connection.py:410, _read_response) 2026-04-29 22:47:35 [ 539 ] DEBUG : Sending request(xid=289): Create(path='/test_snapshot_multinode_recover286', data=b'somedata286', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:35 [ 539 ] DEBUG : Received response(xid=289): '/test_snapshot_multinode_recover286' (connection.py:410, _read_response) 2026-04-29 22:47:35 [ 539 ] DEBUG : Sending request(xid=290): Create(path='/test_snapshot_multinode_recover287', data=b'somedata287', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:35 [ 539 ] DEBUG : Received response(xid=290): '/test_snapshot_multinode_recover287' (connection.py:410, _read_response) 2026-04-29 22:47:35 [ 539 ] DEBUG : Sending request(xid=291): Create(path='/test_snapshot_multinode_recover288', data=b'somedata288', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:35 [ 539 ] DEBUG : Received response(xid=291): '/test_snapshot_multinode_recover288' (connection.py:410, _read_response) 2026-04-29 22:47:35 [ 539 ] DEBUG : Sending request(xid=292): Create(path='/test_snapshot_multinode_recover289', data=b'somedata289', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:35 [ 539 ] DEBUG : Received response(xid=292): '/test_snapshot_multinode_recover289' (connection.py:410, _read_response) 2026-04-29 22:47:35 [ 539 ] DEBUG : Sending request(xid=293): Create(path='/test_snapshot_multinode_recover290', data=b'somedata290', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:35 [ 539 ] DEBUG : Received response(xid=293): '/test_snapshot_multinode_recover290' (connection.py:410, _read_response) 2026-04-29 22:47:35 [ 539 ] DEBUG : Sending request(xid=294): Create(path='/test_snapshot_multinode_recover291', data=b'somedata291', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:35 [ 539 ] DEBUG : Received response(xid=294): '/test_snapshot_multinode_recover291' (connection.py:410, _read_response) 2026-04-29 22:47:35 [ 539 ] DEBUG : Sending request(xid=295): Create(path='/test_snapshot_multinode_recover292', data=b'somedata292', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:35 [ 539 ] DEBUG : Received response(xid=295): '/test_snapshot_multinode_recover292' (connection.py:410, _read_response) 2026-04-29 22:47:35 [ 539 ] DEBUG : Sending request(xid=296): Create(path='/test_snapshot_multinode_recover293', data=b'somedata293', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:35 [ 539 ] DEBUG : Received response(xid=296): '/test_snapshot_multinode_recover293' (connection.py:410, _read_response) 2026-04-29 22:47:35 [ 539 ] DEBUG : Sending request(xid=297): Create(path='/test_snapshot_multinode_recover294', data=b'somedata294', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:35 [ 539 ] DEBUG : Received response(xid=297): '/test_snapshot_multinode_recover294' (connection.py:410, _read_response) 2026-04-29 22:47:35 [ 539 ] DEBUG : Sending request(xid=298): Create(path='/test_snapshot_multinode_recover295', data=b'somedata295', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:35 [ 539 ] DEBUG : Received response(xid=298): '/test_snapshot_multinode_recover295' (connection.py:410, _read_response) 2026-04-29 22:47:35 [ 539 ] DEBUG : Sending request(xid=299): Create(path='/test_snapshot_multinode_recover296', data=b'somedata296', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:35 [ 539 ] DEBUG : Received response(xid=299): '/test_snapshot_multinode_recover296' (connection.py:410, _read_response) 2026-04-29 22:47:35 [ 539 ] DEBUG : Sending request(xid=300): Create(path='/test_snapshot_multinode_recover297', data=b'somedata297', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:35 [ 539 ] DEBUG : Received response(xid=300): '/test_snapshot_multinode_recover297' (connection.py:410, _read_response) 2026-04-29 22:47:35 [ 539 ] DEBUG : Sending request(xid=301): Create(path='/test_snapshot_multinode_recover298', data=b'somedata298', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:35 [ 539 ] DEBUG : Received response(xid=301): '/test_snapshot_multinode_recover298' (connection.py:410, _read_response) 2026-04-29 22:47:35 [ 539 ] DEBUG : Sending request(xid=302): Create(path='/test_snapshot_multinode_recover299', data=b'somedata299', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:35 [ 539 ] DEBUG : Received response(xid=302): '/test_snapshot_multinode_recover299' (connection.py:410, _read_response) 2026-04-29 22:47:35 [ 539 ] DEBUG : Sending request(xid=303): Create(path='/test_snapshot_multinode_recover300', data=b'somedata300', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:35 [ 539 ] DEBUG : Received response(xid=303): '/test_snapshot_multinode_recover300' (connection.py:410, _read_response) 2026-04-29 22:47:35 [ 539 ] DEBUG : Sending request(xid=304): Create(path='/test_snapshot_multinode_recover301', data=b'somedata301', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:35 [ 539 ] DEBUG : Received response(xid=304): '/test_snapshot_multinode_recover301' (connection.py:410, _read_response) 2026-04-29 22:47:35 [ 539 ] DEBUG : Sending request(xid=305): Create(path='/test_snapshot_multinode_recover302', data=b'somedata302', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:35 [ 539 ] DEBUG : Received response(xid=305): '/test_snapshot_multinode_recover302' (connection.py:410, _read_response) 2026-04-29 22:47:35 [ 539 ] DEBUG : Sending request(xid=306): Create(path='/test_snapshot_multinode_recover303', data=b'somedata303', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:35 [ 539 ] DEBUG : Received response(xid=306): '/test_snapshot_multinode_recover303' (connection.py:410, _read_response) 2026-04-29 22:47:35 [ 539 ] DEBUG : Sending request(xid=307): Create(path='/test_snapshot_multinode_recover304', data=b'somedata304', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:35 [ 539 ] DEBUG : Received response(xid=307): '/test_snapshot_multinode_recover304' (connection.py:410, _read_response) 2026-04-29 22:47:35 [ 539 ] DEBUG : Sending request(xid=308): Create(path='/test_snapshot_multinode_recover305', data=b'somedata305', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:35 [ 539 ] DEBUG : Received response(xid=308): '/test_snapshot_multinode_recover305' (connection.py:410, _read_response) 2026-04-29 22:47:35 [ 539 ] DEBUG : Sending request(xid=309): Create(path='/test_snapshot_multinode_recover306', data=b'somedata306', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:36 [ 539 ] DEBUG : Received response(xid=309): '/test_snapshot_multinode_recover306' (connection.py:410, _read_response) 2026-04-29 22:47:36 [ 539 ] DEBUG : Sending request(xid=310): Create(path='/test_snapshot_multinode_recover307', data=b'somedata307', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:36 [ 539 ] DEBUG : Received response(xid=310): '/test_snapshot_multinode_recover307' (connection.py:410, _read_response) 2026-04-29 22:47:36 [ 539 ] DEBUG : Sending request(xid=311): Create(path='/test_snapshot_multinode_recover308', data=b'somedata308', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:36 [ 539 ] DEBUG : Received response(xid=311): '/test_snapshot_multinode_recover308' (connection.py:410, _read_response) 2026-04-29 22:47:36 [ 539 ] DEBUG : Sending request(xid=312): Create(path='/test_snapshot_multinode_recover309', data=b'somedata309', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:36 [ 539 ] DEBUG : Received response(xid=312): '/test_snapshot_multinode_recover309' (connection.py:410, _read_response) 2026-04-29 22:47:36 [ 539 ] DEBUG : Sending request(xid=313): Create(path='/test_snapshot_multinode_recover310', data=b'somedata310', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:36 [ 539 ] DEBUG : Received response(xid=313): '/test_snapshot_multinode_recover310' (connection.py:410, _read_response) 2026-04-29 22:47:36 [ 539 ] DEBUG : Sending request(xid=314): Create(path='/test_snapshot_multinode_recover311', data=b'somedata311', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:36 [ 539 ] DEBUG : Received response(xid=314): '/test_snapshot_multinode_recover311' (connection.py:410, _read_response) 2026-04-29 22:47:36 [ 539 ] DEBUG : Sending request(xid=315): Create(path='/test_snapshot_multinode_recover312', data=b'somedata312', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:36 [ 539 ] DEBUG : Received response(xid=315): '/test_snapshot_multinode_recover312' (connection.py:410, _read_response) 2026-04-29 22:47:36 [ 539 ] DEBUG : Sending request(xid=316): Create(path='/test_snapshot_multinode_recover313', data=b'somedata313', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:36 [ 539 ] DEBUG : Received response(xid=316): '/test_snapshot_multinode_recover313' (connection.py:410, _read_response) 2026-04-29 22:47:36 [ 539 ] DEBUG : Sending request(xid=317): Create(path='/test_snapshot_multinode_recover314', data=b'somedata314', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:36 [ 539 ] DEBUG : Received response(xid=317): '/test_snapshot_multinode_recover314' (connection.py:410, _read_response) 2026-04-29 22:47:36 [ 539 ] DEBUG : Sending request(xid=318): Create(path='/test_snapshot_multinode_recover315', data=b'somedata315', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:36 [ 539 ] DEBUG : Received response(xid=318): '/test_snapshot_multinode_recover315' (connection.py:410, _read_response) 2026-04-29 22:47:36 [ 539 ] DEBUG : Sending request(xid=319): Create(path='/test_snapshot_multinode_recover316', data=b'somedata316', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:36 [ 539 ] DEBUG : Received response(xid=319): '/test_snapshot_multinode_recover316' (connection.py:410, _read_response) 2026-04-29 22:47:36 [ 539 ] DEBUG : Sending request(xid=320): Create(path='/test_snapshot_multinode_recover317', data=b'somedata317', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:36 [ 539 ] DEBUG : Received response(xid=320): '/test_snapshot_multinode_recover317' (connection.py:410, _read_response) 2026-04-29 22:47:36 [ 539 ] DEBUG : Sending request(xid=321): Create(path='/test_snapshot_multinode_recover318', data=b'somedata318', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:36 [ 539 ] DEBUG : Received response(xid=321): '/test_snapshot_multinode_recover318' (connection.py:410, _read_response) 2026-04-29 22:47:36 [ 539 ] DEBUG : Sending request(xid=322): Create(path='/test_snapshot_multinode_recover319', data=b'somedata319', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:36 [ 539 ] DEBUG : Received response(xid=322): '/test_snapshot_multinode_recover319' (connection.py:410, _read_response) 2026-04-29 22:47:36 [ 539 ] DEBUG : Sending request(xid=323): Create(path='/test_snapshot_multinode_recover320', data=b'somedata320', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:36 [ 539 ] DEBUG : Received response(xid=323): '/test_snapshot_multinode_recover320' (connection.py:410, _read_response) 2026-04-29 22:47:36 [ 539 ] DEBUG : Sending request(xid=324): Create(path='/test_snapshot_multinode_recover321', data=b'somedata321', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:36 [ 539 ] DEBUG : Received response(xid=324): '/test_snapshot_multinode_recover321' (connection.py:410, _read_response) 2026-04-29 22:47:36 [ 539 ] DEBUG : Sending request(xid=325): Create(path='/test_snapshot_multinode_recover322', data=b'somedata322', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:36 [ 539 ] DEBUG : Received response(xid=325): '/test_snapshot_multinode_recover322' (connection.py:410, _read_response) 2026-04-29 22:47:36 [ 539 ] DEBUG : Sending request(xid=326): Create(path='/test_snapshot_multinode_recover323', data=b'somedata323', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:36 [ 539 ] DEBUG : Received response(xid=326): '/test_snapshot_multinode_recover323' (connection.py:410, _read_response) 2026-04-29 22:47:36 [ 539 ] DEBUG : Sending request(xid=327): Create(path='/test_snapshot_multinode_recover324', data=b'somedata324', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:36 [ 539 ] DEBUG : Received response(xid=327): '/test_snapshot_multinode_recover324' (connection.py:410, _read_response) 2026-04-29 22:47:36 [ 539 ] DEBUG : Sending request(xid=328): Create(path='/test_snapshot_multinode_recover325', data=b'somedata325', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:36 [ 539 ] DEBUG : Received response(xid=328): '/test_snapshot_multinode_recover325' (connection.py:410, _read_response) 2026-04-29 22:47:36 [ 539 ] DEBUG : Sending request(xid=329): Create(path='/test_snapshot_multinode_recover326', data=b'somedata326', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:36 [ 539 ] DEBUG : Received response(xid=329): '/test_snapshot_multinode_recover326' (connection.py:410, _read_response) 2026-04-29 22:47:36 [ 539 ] DEBUG : Sending request(xid=330): Create(path='/test_snapshot_multinode_recover327', data=b'somedata327', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:36 [ 539 ] DEBUG : Received response(xid=330): '/test_snapshot_multinode_recover327' (connection.py:410, _read_response) 2026-04-29 22:47:36 [ 539 ] DEBUG : Sending request(xid=331): Create(path='/test_snapshot_multinode_recover328', data=b'somedata328', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:36 [ 539 ] DEBUG : Received response(xid=331): '/test_snapshot_multinode_recover328' (connection.py:410, _read_response) 2026-04-29 22:47:36 [ 539 ] DEBUG : Sending request(xid=332): Create(path='/test_snapshot_multinode_recover329', data=b'somedata329', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:36 [ 539 ] DEBUG : Received response(xid=332): '/test_snapshot_multinode_recover329' (connection.py:410, _read_response) 2026-04-29 22:47:36 [ 539 ] DEBUG : Sending request(xid=333): Create(path='/test_snapshot_multinode_recover330', data=b'somedata330', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:36 [ 539 ] DEBUG : Received response(xid=333): '/test_snapshot_multinode_recover330' (connection.py:410, _read_response) 2026-04-29 22:47:36 [ 539 ] DEBUG : Sending request(xid=334): Create(path='/test_snapshot_multinode_recover331', data=b'somedata331', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:36 [ 539 ] DEBUG : Received response(xid=334): '/test_snapshot_multinode_recover331' (connection.py:410, _read_response) 2026-04-29 22:47:36 [ 539 ] DEBUG : Sending request(xid=335): Create(path='/test_snapshot_multinode_recover332', data=b'somedata332', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:36 [ 539 ] DEBUG : Received response(xid=335): '/test_snapshot_multinode_recover332' (connection.py:410, _read_response) 2026-04-29 22:47:36 [ 539 ] DEBUG : Sending request(xid=336): Create(path='/test_snapshot_multinode_recover333', data=b'somedata333', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:36 [ 539 ] DEBUG : Received response(xid=336): '/test_snapshot_multinode_recover333' (connection.py:410, _read_response) 2026-04-29 22:47:36 [ 539 ] DEBUG : Sending request(xid=337): Create(path='/test_snapshot_multinode_recover334', data=b'somedata334', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:36 [ 539 ] DEBUG : Received response(xid=337): '/test_snapshot_multinode_recover334' (connection.py:410, _read_response) 2026-04-29 22:47:36 [ 539 ] DEBUG : Sending request(xid=338): Create(path='/test_snapshot_multinode_recover335', data=b'somedata335', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:36 [ 539 ] DEBUG : Received response(xid=338): '/test_snapshot_multinode_recover335' (connection.py:410, _read_response) 2026-04-29 22:47:36 [ 539 ] DEBUG : Sending request(xid=339): Create(path='/test_snapshot_multinode_recover336', data=b'somedata336', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:36 [ 539 ] DEBUG : Received response(xid=339): '/test_snapshot_multinode_recover336' (connection.py:410, _read_response) 2026-04-29 22:47:36 [ 539 ] DEBUG : Sending request(xid=340): Create(path='/test_snapshot_multinode_recover337', data=b'somedata337', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:36 [ 539 ] DEBUG : Received response(xid=340): '/test_snapshot_multinode_recover337' (connection.py:410, _read_response) 2026-04-29 22:47:36 [ 539 ] DEBUG : Sending request(xid=341): Create(path='/test_snapshot_multinode_recover338', data=b'somedata338', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:36 [ 539 ] DEBUG : Received response(xid=341): '/test_snapshot_multinode_recover338' (connection.py:410, _read_response) 2026-04-29 22:47:36 [ 539 ] DEBUG : Sending request(xid=342): Create(path='/test_snapshot_multinode_recover339', data=b'somedata339', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:37 [ 539 ] DEBUG : Received response(xid=342): '/test_snapshot_multinode_recover339' (connection.py:410, _read_response) 2026-04-29 22:47:37 [ 539 ] DEBUG : Sending request(xid=343): Create(path='/test_snapshot_multinode_recover340', data=b'somedata340', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:37 [ 539 ] DEBUG : Received response(xid=343): '/test_snapshot_multinode_recover340' (connection.py:410, _read_response) 2026-04-29 22:47:37 [ 539 ] DEBUG : Sending request(xid=344): Create(path='/test_snapshot_multinode_recover341', data=b'somedata341', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:37 [ 539 ] DEBUG : Received response(xid=344): '/test_snapshot_multinode_recover341' (connection.py:410, _read_response) 2026-04-29 22:47:37 [ 539 ] DEBUG : Sending request(xid=345): Create(path='/test_snapshot_multinode_recover342', data=b'somedata342', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:37 [ 539 ] DEBUG : Received response(xid=345): '/test_snapshot_multinode_recover342' (connection.py:410, _read_response) 2026-04-29 22:47:37 [ 539 ] DEBUG : Sending request(xid=346): Create(path='/test_snapshot_multinode_recover343', data=b'somedata343', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:37 [ 539 ] DEBUG : Received response(xid=346): '/test_snapshot_multinode_recover343' (connection.py:410, _read_response) 2026-04-29 22:47:37 [ 539 ] DEBUG : Sending request(xid=347): Create(path='/test_snapshot_multinode_recover344', data=b'somedata344', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:37 [ 539 ] DEBUG : Received response(xid=347): '/test_snapshot_multinode_recover344' (connection.py:410, _read_response) 2026-04-29 22:47:37 [ 539 ] DEBUG : Sending request(xid=348): Create(path='/test_snapshot_multinode_recover345', data=b'somedata345', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:37 [ 539 ] DEBUG : Received response(xid=348): '/test_snapshot_multinode_recover345' (connection.py:410, _read_response) 2026-04-29 22:47:37 [ 539 ] DEBUG : Sending request(xid=349): Create(path='/test_snapshot_multinode_recover346', data=b'somedata346', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:37 [ 539 ] DEBUG : Received response(xid=349): '/test_snapshot_multinode_recover346' (connection.py:410, _read_response) 2026-04-29 22:47:37 [ 539 ] DEBUG : Sending request(xid=350): Create(path='/test_snapshot_multinode_recover347', data=b'somedata347', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:37 [ 539 ] DEBUG : Received response(xid=350): '/test_snapshot_multinode_recover347' (connection.py:410, _read_response) 2026-04-29 22:47:37 [ 539 ] DEBUG : Sending request(xid=351): Create(path='/test_snapshot_multinode_recover348', data=b'somedata348', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:37 [ 539 ] DEBUG : Received response(xid=351): '/test_snapshot_multinode_recover348' (connection.py:410, _read_response) 2026-04-29 22:47:37 [ 539 ] DEBUG : Sending request(xid=352): Create(path='/test_snapshot_multinode_recover349', data=b'somedata349', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:37 [ 539 ] DEBUG : Received response(xid=352): '/test_snapshot_multinode_recover349' (connection.py:410, _read_response) 2026-04-29 22:47:37 [ 539 ] DEBUG : Sending request(xid=353): Create(path='/test_snapshot_multinode_recover350', data=b'somedata350', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:37 [ 539 ] DEBUG : Received response(xid=353): '/test_snapshot_multinode_recover350' (connection.py:410, _read_response) 2026-04-29 22:47:37 [ 539 ] DEBUG : Sending request(xid=354): Create(path='/test_snapshot_multinode_recover351', data=b'somedata351', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:37 [ 539 ] DEBUG : Received response(xid=354): '/test_snapshot_multinode_recover351' (connection.py:410, _read_response) 2026-04-29 22:47:37 [ 539 ] DEBUG : Sending request(xid=355): Create(path='/test_snapshot_multinode_recover352', data=b'somedata352', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:37 [ 539 ] DEBUG : Received response(xid=355): '/test_snapshot_multinode_recover352' (connection.py:410, _read_response) 2026-04-29 22:47:37 [ 539 ] DEBUG : Sending request(xid=356): Create(path='/test_snapshot_multinode_recover353', data=b'somedata353', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:37 [ 539 ] DEBUG : Received response(xid=356): '/test_snapshot_multinode_recover353' (connection.py:410, _read_response) 2026-04-29 22:47:37 [ 539 ] DEBUG : Sending request(xid=357): Create(path='/test_snapshot_multinode_recover354', data=b'somedata354', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:37 [ 539 ] DEBUG : Received response(xid=357): '/test_snapshot_multinode_recover354' (connection.py:410, _read_response) 2026-04-29 22:47:37 [ 539 ] DEBUG : Sending request(xid=358): Create(path='/test_snapshot_multinode_recover355', data=b'somedata355', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:37 [ 539 ] DEBUG : Received response(xid=358): '/test_snapshot_multinode_recover355' (connection.py:410, _read_response) 2026-04-29 22:47:37 [ 539 ] DEBUG : Sending request(xid=359): Create(path='/test_snapshot_multinode_recover356', data=b'somedata356', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:37 [ 539 ] DEBUG : Received response(xid=359): '/test_snapshot_multinode_recover356' (connection.py:410, _read_response) 2026-04-29 22:47:37 [ 539 ] DEBUG : Sending request(xid=360): Create(path='/test_snapshot_multinode_recover357', data=b'somedata357', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:37 [ 539 ] DEBUG : Received response(xid=360): '/test_snapshot_multinode_recover357' (connection.py:410, _read_response) 2026-04-29 22:47:37 [ 539 ] DEBUG : Sending request(xid=361): Create(path='/test_snapshot_multinode_recover358', data=b'somedata358', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:37 [ 539 ] DEBUG : Received response(xid=361): '/test_snapshot_multinode_recover358' (connection.py:410, _read_response) 2026-04-29 22:47:37 [ 539 ] DEBUG : Sending request(xid=362): Create(path='/test_snapshot_multinode_recover359', data=b'somedata359', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:37 [ 539 ] DEBUG : Received response(xid=362): '/test_snapshot_multinode_recover359' (connection.py:410, _read_response) 2026-04-29 22:47:37 [ 539 ] DEBUG : Sending request(xid=363): Create(path='/test_snapshot_multinode_recover360', data=b'somedata360', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:37 [ 539 ] DEBUG : Received response(xid=363): '/test_snapshot_multinode_recover360' (connection.py:410, _read_response) 2026-04-29 22:47:37 [ 539 ] DEBUG : Sending request(xid=364): Create(path='/test_snapshot_multinode_recover361', data=b'somedata361', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:37 [ 539 ] DEBUG : Received response(xid=364): '/test_snapshot_multinode_recover361' (connection.py:410, _read_response) 2026-04-29 22:47:37 [ 539 ] DEBUG : Sending request(xid=365): Create(path='/test_snapshot_multinode_recover362', data=b'somedata362', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:37 [ 539 ] DEBUG : Received response(xid=365): '/test_snapshot_multinode_recover362' (connection.py:410, _read_response) 2026-04-29 22:47:37 [ 539 ] DEBUG : Sending request(xid=366): Create(path='/test_snapshot_multinode_recover363', data=b'somedata363', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:37 [ 539 ] DEBUG : Received response(xid=366): '/test_snapshot_multinode_recover363' (connection.py:410, _read_response) 2026-04-29 22:47:37 [ 539 ] DEBUG : Sending request(xid=367): Create(path='/test_snapshot_multinode_recover364', data=b'somedata364', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:37 [ 539 ] DEBUG : Received response(xid=367): '/test_snapshot_multinode_recover364' (connection.py:410, _read_response) 2026-04-29 22:47:37 [ 539 ] DEBUG : Sending request(xid=368): Create(path='/test_snapshot_multinode_recover365', data=b'somedata365', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:37 [ 539 ] DEBUG : Received response(xid=368): '/test_snapshot_multinode_recover365' (connection.py:410, _read_response) 2026-04-29 22:47:37 [ 539 ] DEBUG : Sending request(xid=369): Create(path='/test_snapshot_multinode_recover366', data=b'somedata366', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:37 [ 539 ] DEBUG : Received response(xid=369): '/test_snapshot_multinode_recover366' (connection.py:410, _read_response) 2026-04-29 22:47:37 [ 539 ] DEBUG : Sending request(xid=370): Create(path='/test_snapshot_multinode_recover367', data=b'somedata367', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:37 [ 539 ] DEBUG : Received response(xid=370): '/test_snapshot_multinode_recover367' (connection.py:410, _read_response) 2026-04-29 22:47:37 [ 539 ] DEBUG : Sending request(xid=371): Create(path='/test_snapshot_multinode_recover368', data=b'somedata368', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:37 [ 539 ] DEBUG : Received response(xid=371): '/test_snapshot_multinode_recover368' (connection.py:410, _read_response) 2026-04-29 22:47:37 [ 539 ] DEBUG : Sending request(xid=372): Create(path='/test_snapshot_multinode_recover369', data=b'somedata369', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:37 [ 539 ] DEBUG : Received response(xid=372): '/test_snapshot_multinode_recover369' (connection.py:410, _read_response) 2026-04-29 22:47:37 [ 539 ] DEBUG : Sending request(xid=373): Create(path='/test_snapshot_multinode_recover370', data=b'somedata370', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:37 [ 539 ] DEBUG : Received response(xid=373): '/test_snapshot_multinode_recover370' (connection.py:410, _read_response) 2026-04-29 22:47:37 [ 539 ] DEBUG : Sending request(xid=374): Create(path='/test_snapshot_multinode_recover371', data=b'somedata371', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:37 [ 539 ] DEBUG : Received response(xid=374): '/test_snapshot_multinode_recover371' (connection.py:410, _read_response) 2026-04-29 22:47:37 [ 539 ] DEBUG : Sending request(xid=375): Create(path='/test_snapshot_multinode_recover372', data=b'somedata372', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:37 [ 539 ] DEBUG : Received response(xid=375): '/test_snapshot_multinode_recover372' (connection.py:410, _read_response) 2026-04-29 22:47:37 [ 539 ] DEBUG : Sending request(xid=376): Create(path='/test_snapshot_multinode_recover373', data=b'somedata373', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:37 [ 539 ] DEBUG : Received response(xid=376): '/test_snapshot_multinode_recover373' (connection.py:410, _read_response) 2026-04-29 22:47:37 [ 539 ] DEBUG : Sending request(xid=377): Create(path='/test_snapshot_multinode_recover374', data=b'somedata374', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:37 [ 539 ] DEBUG : Received response(xid=377): '/test_snapshot_multinode_recover374' (connection.py:410, _read_response) 2026-04-29 22:47:37 [ 539 ] DEBUG : Sending request(xid=378): Create(path='/test_snapshot_multinode_recover375', data=b'somedata375', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:37 [ 539 ] DEBUG : Received response(xid=378): '/test_snapshot_multinode_recover375' (connection.py:410, _read_response) 2026-04-29 22:47:37 [ 539 ] DEBUG : Sending request(xid=379): Create(path='/test_snapshot_multinode_recover376', data=b'somedata376', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:37 [ 539 ] DEBUG : Received response(xid=379): '/test_snapshot_multinode_recover376' (connection.py:410, _read_response) 2026-04-29 22:47:37 [ 539 ] DEBUG : Sending request(xid=380): Create(path='/test_snapshot_multinode_recover377', data=b'somedata377', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:37 [ 539 ] DEBUG : Received response(xid=380): '/test_snapshot_multinode_recover377' (connection.py:410, _read_response) 2026-04-29 22:47:37 [ 539 ] DEBUG : Sending request(xid=381): Create(path='/test_snapshot_multinode_recover378', data=b'somedata378', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:37 [ 539 ] DEBUG : Received response(xid=381): '/test_snapshot_multinode_recover378' (connection.py:410, _read_response) 2026-04-29 22:47:37 [ 539 ] DEBUG : Sending request(xid=382): Create(path='/test_snapshot_multinode_recover379', data=b'somedata379', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:37 [ 539 ] DEBUG : Received response(xid=382): '/test_snapshot_multinode_recover379' (connection.py:410, _read_response) 2026-04-29 22:47:37 [ 539 ] DEBUG : Sending request(xid=383): Create(path='/test_snapshot_multinode_recover380', data=b'somedata380', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:37 [ 539 ] DEBUG : Received response(xid=383): '/test_snapshot_multinode_recover380' (connection.py:410, _read_response) 2026-04-29 22:47:37 [ 539 ] DEBUG : Sending request(xid=384): Create(path='/test_snapshot_multinode_recover381', data=b'somedata381', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:37 [ 539 ] DEBUG : Received response(xid=384): '/test_snapshot_multinode_recover381' (connection.py:410, _read_response) 2026-04-29 22:47:38 [ 539 ] DEBUG : Sending request(xid=385): Create(path='/test_snapshot_multinode_recover382', data=b'somedata382', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:38 [ 539 ] DEBUG : Received response(xid=385): '/test_snapshot_multinode_recover382' (connection.py:410, _read_response) 2026-04-29 22:47:38 [ 539 ] DEBUG : Sending request(xid=386): Create(path='/test_snapshot_multinode_recover383', data=b'somedata383', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:38 [ 539 ] DEBUG : Received response(xid=386): '/test_snapshot_multinode_recover383' (connection.py:410, _read_response) 2026-04-29 22:47:38 [ 539 ] DEBUG : Sending request(xid=387): Create(path='/test_snapshot_multinode_recover384', data=b'somedata384', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:38 [ 539 ] DEBUG : Received response(xid=387): '/test_snapshot_multinode_recover384' (connection.py:410, _read_response) 2026-04-29 22:47:38 [ 539 ] DEBUG : Sending request(xid=388): Create(path='/test_snapshot_multinode_recover385', data=b'somedata385', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:38 [ 539 ] DEBUG : Received response(xid=388): '/test_snapshot_multinode_recover385' (connection.py:410, _read_response) 2026-04-29 22:47:38 [ 539 ] DEBUG : Sending request(xid=389): Create(path='/test_snapshot_multinode_recover386', data=b'somedata386', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:38 [ 539 ] DEBUG : Received response(xid=389): '/test_snapshot_multinode_recover386' (connection.py:410, _read_response) 2026-04-29 22:47:38 [ 539 ] DEBUG : Sending request(xid=390): Create(path='/test_snapshot_multinode_recover387', data=b'somedata387', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:38 [ 539 ] DEBUG : Received response(xid=390): '/test_snapshot_multinode_recover387' (connection.py:410, _read_response) 2026-04-29 22:47:38 [ 539 ] DEBUG : Sending request(xid=391): Create(path='/test_snapshot_multinode_recover388', data=b'somedata388', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:38 [ 539 ] DEBUG : Received response(xid=391): '/test_snapshot_multinode_recover388' (connection.py:410, _read_response) 2026-04-29 22:47:38 [ 539 ] DEBUG : Sending request(xid=392): Create(path='/test_snapshot_multinode_recover389', data=b'somedata389', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:38 [ 539 ] DEBUG : Received response(xid=392): '/test_snapshot_multinode_recover389' (connection.py:410, _read_response) 2026-04-29 22:47:38 [ 539 ] DEBUG : Sending request(xid=393): Create(path='/test_snapshot_multinode_recover390', data=b'somedata390', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:38 [ 539 ] DEBUG : Received response(xid=393): '/test_snapshot_multinode_recover390' (connection.py:410, _read_response) 2026-04-29 22:47:38 [ 539 ] DEBUG : Sending request(xid=394): Create(path='/test_snapshot_multinode_recover391', data=b'somedata391', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:38 [ 539 ] DEBUG : Received response(xid=394): '/test_snapshot_multinode_recover391' (connection.py:410, _read_response) 2026-04-29 22:47:38 [ 539 ] DEBUG : Sending request(xid=395): Create(path='/test_snapshot_multinode_recover392', data=b'somedata392', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:38 [ 539 ] DEBUG : Received response(xid=395): '/test_snapshot_multinode_recover392' (connection.py:410, _read_response) 2026-04-29 22:47:38 [ 539 ] DEBUG : Sending request(xid=396): Create(path='/test_snapshot_multinode_recover393', data=b'somedata393', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:38 [ 539 ] DEBUG : Received response(xid=396): '/test_snapshot_multinode_recover393' (connection.py:410, _read_response) 2026-04-29 22:47:38 [ 539 ] DEBUG : Sending request(xid=397): Create(path='/test_snapshot_multinode_recover394', data=b'somedata394', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:38 [ 539 ] DEBUG : Received response(xid=397): '/test_snapshot_multinode_recover394' (connection.py:410, _read_response) 2026-04-29 22:47:38 [ 539 ] DEBUG : Sending request(xid=398): Create(path='/test_snapshot_multinode_recover395', data=b'somedata395', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:38 [ 539 ] DEBUG : Received response(xid=398): '/test_snapshot_multinode_recover395' (connection.py:410, _read_response) 2026-04-29 22:47:38 [ 539 ] DEBUG : Sending request(xid=399): Create(path='/test_snapshot_multinode_recover396', data=b'somedata396', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:38 [ 539 ] DEBUG : Received response(xid=399): '/test_snapshot_multinode_recover396' (connection.py:410, _read_response) 2026-04-29 22:47:38 [ 539 ] DEBUG : Sending request(xid=400): Create(path='/test_snapshot_multinode_recover397', data=b'somedata397', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:38 [ 539 ] DEBUG : Received response(xid=400): '/test_snapshot_multinode_recover397' (connection.py:410, _read_response) 2026-04-29 22:47:38 [ 539 ] DEBUG : Sending request(xid=401): Create(path='/test_snapshot_multinode_recover398', data=b'somedata398', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:38 [ 539 ] DEBUG : Received response(xid=401): '/test_snapshot_multinode_recover398' (connection.py:410, _read_response) 2026-04-29 22:47:38 [ 539 ] DEBUG : Sending request(xid=402): Create(path='/test_snapshot_multinode_recover399', data=b'somedata399', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:38 [ 539 ] DEBUG : Received response(xid=402): '/test_snapshot_multinode_recover399' (connection.py:410, _read_response) 2026-04-29 22:47:38 [ 539 ] DEBUG : Sending request(xid=403): Create(path='/test_snapshot_multinode_recover400', data=b'somedata400', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:38 [ 539 ] DEBUG : Received response(xid=403): '/test_snapshot_multinode_recover400' (connection.py:410, _read_response) 2026-04-29 22:47:38 [ 539 ] DEBUG : Sending request(xid=404): Create(path='/test_snapshot_multinode_recover401', data=b'somedata401', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:38 [ 539 ] DEBUG : Received response(xid=404): '/test_snapshot_multinode_recover401' (connection.py:410, _read_response) 2026-04-29 22:47:38 [ 539 ] DEBUG : Sending request(xid=405): Create(path='/test_snapshot_multinode_recover402', data=b'somedata402', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:38 [ 539 ] DEBUG : Received response(xid=405): '/test_snapshot_multinode_recover402' (connection.py:410, _read_response) 2026-04-29 22:47:38 [ 539 ] DEBUG : Sending request(xid=406): Create(path='/test_snapshot_multinode_recover403', data=b'somedata403', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:38 [ 539 ] DEBUG : Received response(xid=406): '/test_snapshot_multinode_recover403' (connection.py:410, _read_response) 2026-04-29 22:47:38 [ 539 ] DEBUG : Sending request(xid=407): Create(path='/test_snapshot_multinode_recover404', data=b'somedata404', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:38 [ 539 ] DEBUG : Received response(xid=407): '/test_snapshot_multinode_recover404' (connection.py:410, _read_response) 2026-04-29 22:47:38 [ 539 ] DEBUG : Sending request(xid=408): Create(path='/test_snapshot_multinode_recover405', data=b'somedata405', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:38 [ 539 ] DEBUG : Received response(xid=408): '/test_snapshot_multinode_recover405' (connection.py:410, _read_response) 2026-04-29 22:47:38 [ 539 ] DEBUG : Sending request(xid=409): Create(path='/test_snapshot_multinode_recover406', data=b'somedata406', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:38 [ 539 ] DEBUG : Received response(xid=409): '/test_snapshot_multinode_recover406' (connection.py:410, _read_response) 2026-04-29 22:47:38 [ 539 ] DEBUG : Sending request(xid=410): Create(path='/test_snapshot_multinode_recover407', data=b'somedata407', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:38 [ 539 ] DEBUG : Received response(xid=410): '/test_snapshot_multinode_recover407' (connection.py:410, _read_response) 2026-04-29 22:47:38 [ 539 ] DEBUG : Sending request(xid=411): Create(path='/test_snapshot_multinode_recover408', data=b'somedata408', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:38 [ 539 ] DEBUG : Received response(xid=411): '/test_snapshot_multinode_recover408' (connection.py:410, _read_response) 2026-04-29 22:47:38 [ 539 ] DEBUG : Sending request(xid=412): Create(path='/test_snapshot_multinode_recover409', data=b'somedata409', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:38 [ 539 ] DEBUG : Received response(xid=412): '/test_snapshot_multinode_recover409' (connection.py:410, _read_response) 2026-04-29 22:47:38 [ 539 ] DEBUG : Sending request(xid=413): Create(path='/test_snapshot_multinode_recover410', data=b'somedata410', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:38 [ 539 ] DEBUG : Received response(xid=413): '/test_snapshot_multinode_recover410' (connection.py:410, _read_response) 2026-04-29 22:47:38 [ 539 ] DEBUG : Sending request(xid=414): Create(path='/test_snapshot_multinode_recover411', data=b'somedata411', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:38 [ 539 ] DEBUG : Received response(xid=414): '/test_snapshot_multinode_recover411' (connection.py:410, _read_response) 2026-04-29 22:47:38 [ 539 ] DEBUG : Sending request(xid=415): Create(path='/test_snapshot_multinode_recover412', data=b'somedata412', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:38 [ 539 ] DEBUG : Received response(xid=415): '/test_snapshot_multinode_recover412' (connection.py:410, _read_response) 2026-04-29 22:47:38 [ 539 ] DEBUG : Sending request(xid=416): Create(path='/test_snapshot_multinode_recover413', data=b'somedata413', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:38 [ 539 ] DEBUG : Received response(xid=416): '/test_snapshot_multinode_recover413' (connection.py:410, _read_response) 2026-04-29 22:47:38 [ 539 ] DEBUG : Sending request(xid=417): Create(path='/test_snapshot_multinode_recover414', data=b'somedata414', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:38 [ 539 ] DEBUG : Received response(xid=417): '/test_snapshot_multinode_recover414' (connection.py:410, _read_response) 2026-04-29 22:47:38 [ 539 ] DEBUG : Sending request(xid=418): Create(path='/test_snapshot_multinode_recover415', data=b'somedata415', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:38 [ 539 ] DEBUG : Received response(xid=418): '/test_snapshot_multinode_recover415' (connection.py:410, _read_response) 2026-04-29 22:47:38 [ 539 ] DEBUG : Sending request(xid=419): Create(path='/test_snapshot_multinode_recover416', data=b'somedata416', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:38 [ 539 ] DEBUG : Received response(xid=419): '/test_snapshot_multinode_recover416' (connection.py:410, _read_response) 2026-04-29 22:47:38 [ 539 ] DEBUG : Sending request(xid=420): Create(path='/test_snapshot_multinode_recover417', data=b'somedata417', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:39 [ 539 ] DEBUG : Received response(xid=420): '/test_snapshot_multinode_recover417' (connection.py:410, _read_response) 2026-04-29 22:47:39 [ 539 ] DEBUG : Sending request(xid=421): Create(path='/test_snapshot_multinode_recover418', data=b'somedata418', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:39 [ 539 ] DEBUG : Received response(xid=421): '/test_snapshot_multinode_recover418' (connection.py:410, _read_response) 2026-04-29 22:47:39 [ 539 ] DEBUG : Sending request(xid=422): Create(path='/test_snapshot_multinode_recover419', data=b'somedata419', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:39 [ 539 ] DEBUG : Received response(xid=422): '/test_snapshot_multinode_recover419' (connection.py:410, _read_response) 2026-04-29 22:47:39 [ 539 ] DEBUG : Sending request(xid=423): Create(path='/test_snapshot_multinode_recover420', data=b'somedata420', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:39 [ 539 ] DEBUG : Received response(xid=423): '/test_snapshot_multinode_recover420' (connection.py:410, _read_response) 2026-04-29 22:47:39 [ 539 ] DEBUG : Sending request(xid=424): Create(path='/test_snapshot_multinode_recover421', data=b'somedata421', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:39 [ 539 ] DEBUG : Received response(xid=424): '/test_snapshot_multinode_recover421' (connection.py:410, _read_response) 2026-04-29 22:47:39 [ 539 ] DEBUG : Sending request(xid=425): Create(path='/test_snapshot_multinode_recover422', data=b'somedata422', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:39 [ 539 ] DEBUG : Received response(xid=425): '/test_snapshot_multinode_recover422' (connection.py:410, _read_response) 2026-04-29 22:47:39 [ 539 ] DEBUG : Sending request(xid=426): Create(path='/test_snapshot_multinode_recover423', data=b'somedata423', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:39 [ 539 ] DEBUG : Received response(xid=426): '/test_snapshot_multinode_recover423' (connection.py:410, _read_response) 2026-04-29 22:47:39 [ 539 ] DEBUG : Sending request(xid=427): Create(path='/test_snapshot_multinode_recover424', data=b'somedata424', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:39 [ 539 ] DEBUG : Received response(xid=427): '/test_snapshot_multinode_recover424' (connection.py:410, _read_response) 2026-04-29 22:47:39 [ 539 ] DEBUG : Sending request(xid=428): Create(path='/test_snapshot_multinode_recover425', data=b'somedata425', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:39 [ 539 ] DEBUG : Received response(xid=428): '/test_snapshot_multinode_recover425' (connection.py:410, _read_response) 2026-04-29 22:47:39 [ 539 ] DEBUG : Sending request(xid=429): Create(path='/test_snapshot_multinode_recover426', data=b'somedata426', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:39 [ 539 ] DEBUG : Received response(xid=429): '/test_snapshot_multinode_recover426' (connection.py:410, _read_response) 2026-04-29 22:47:39 [ 539 ] DEBUG : Sending request(xid=430): Create(path='/test_snapshot_multinode_recover427', data=b'somedata427', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:39 [ 539 ] DEBUG : Received response(xid=430): '/test_snapshot_multinode_recover427' (connection.py:410, _read_response) 2026-04-29 22:47:39 [ 539 ] DEBUG : Sending request(xid=431): Create(path='/test_snapshot_multinode_recover428', data=b'somedata428', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:39 [ 539 ] DEBUG : Received response(xid=431): '/test_snapshot_multinode_recover428' (connection.py:410, _read_response) 2026-04-29 22:47:39 [ 539 ] DEBUG : Sending request(xid=432): Create(path='/test_snapshot_multinode_recover429', data=b'somedata429', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:39 [ 539 ] DEBUG : Received response(xid=432): '/test_snapshot_multinode_recover429' (connection.py:410, _read_response) 2026-04-29 22:47:39 [ 539 ] DEBUG : Sending request(xid=433): Create(path='/test_snapshot_multinode_recover430', data=b'somedata430', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:39 [ 539 ] DEBUG : Received response(xid=433): '/test_snapshot_multinode_recover430' (connection.py:410, _read_response) 2026-04-29 22:47:39 [ 539 ] DEBUG : Sending request(xid=434): Create(path='/test_snapshot_multinode_recover431', data=b'somedata431', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:39 [ 539 ] DEBUG : Received response(xid=434): '/test_snapshot_multinode_recover431' (connection.py:410, _read_response) 2026-04-29 22:47:39 [ 539 ] DEBUG : Sending request(xid=435): Create(path='/test_snapshot_multinode_recover432', data=b'somedata432', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:39 [ 539 ] DEBUG : Received response(xid=435): '/test_snapshot_multinode_recover432' (connection.py:410, _read_response) 2026-04-29 22:47:39 [ 539 ] DEBUG : Sending request(xid=436): Create(path='/test_snapshot_multinode_recover433', data=b'somedata433', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:39 [ 539 ] DEBUG : Received response(xid=436): '/test_snapshot_multinode_recover433' (connection.py:410, _read_response) 2026-04-29 22:47:39 [ 539 ] DEBUG : Sending request(xid=437): Create(path='/test_snapshot_multinode_recover434', data=b'somedata434', acl=[ACL(perms=31, acl_list=['ALL'], id=Id(scheme='world', id='anyone'))], flags=0) (connection.py:312, _submit) 2026-04-29 22:47:39 [ 539 ] DEBUG : Received response(xid=437): '/test_snapshot_multinode_recover434' (connection.py:410, _read_response) 2026-04-29 22:47:39 [ 539 ] DEBUG : Sending request(xid=438): Delete(path='/test_snapshot_multinode_recover0', version=-1) (connection.py:312, _submit) 2026-04-29 22:47:39 [ 539 ] DEBUG : Received response(xid=438): True (connection.py:410, _read_response) 2026-04-29 22:47:39 [ 539 ] DEBUG : Sending request(xid=439): Delete(path='/test_snapshot_multinode_recover10', version=-1) (connection.py:312, _submit) 2026-04-29 22:47:39 [ 539 ] DEBUG : Received response(xid=439): True (connection.py:410, _read_response) 2026-04-29 22:47:39 [ 539 ] DEBUG : Sending request(xid=440): Delete(path='/test_snapshot_multinode_recover20', version=-1) (connection.py:312, _submit) 2026-04-29 22:47:39 [ 539 ] DEBUG : Received response(xid=440): True (connection.py:410, _read_response) 2026-04-29 22:47:39 [ 539 ] DEBUG : Sending request(xid=441): Delete(path='/test_snapshot_multinode_recover30', version=-1) (connection.py:312, _submit) 2026-04-29 22:47:39 [ 539 ] DEBUG : Received response(xid=441): True (connection.py:410, _read_response) 2026-04-29 22:47:39 [ 539 ] DEBUG : Sending request(xid=442): Delete(path='/test_snapshot_multinode_recover40', version=-1) (connection.py:312, _submit) 2026-04-29 22:47:39 [ 539 ] DEBUG : Received response(xid=442): True (connection.py:410, _read_response) 2026-04-29 22:47:39 [ 539 ] DEBUG : Sending request(xid=443): Delete(path='/test_snapshot_multinode_recover50', version=-1) (connection.py:312, _submit) 2026-04-29 22:47:39 [ 539 ] DEBUG : Received response(xid=443): True (connection.py:410, _read_response) 2026-04-29 22:47:39 [ 539 ] DEBUG : Sending request(xid=444): Delete(path='/test_snapshot_multinode_recover60', version=-1) (connection.py:312, _submit) 2026-04-29 22:47:39 [ 539 ] DEBUG : Received response(xid=444): True (connection.py:410, _read_response) 2026-04-29 22:47:39 [ 539 ] DEBUG : Sending request(xid=445): Delete(path='/test_snapshot_multinode_recover70', version=-1) (connection.py:312, _submit) 2026-04-29 22:47:39 [ 539 ] DEBUG : Received response(xid=445): True (connection.py:410, _read_response) 2026-04-29 22:47:39 [ 539 ] DEBUG : Sending request(xid=446): Delete(path='/test_snapshot_multinode_recover80', version=-1) (connection.py:312, _submit) 2026-04-29 22:47:39 [ 539 ] DEBUG : Received response(xid=446): True (connection.py:410, _read_response) 2026-04-29 22:47:39 [ 539 ] DEBUG : Sending request(xid=447): Delete(path='/test_snapshot_multinode_recover90', version=-1) (connection.py:312, _submit) 2026-04-29 22:47:39 [ 539 ] DEBUG : Received response(xid=447): True (connection.py:410, _read_response) 2026-04-29 22:47:39 [ 539 ] DEBUG : Sending request(xid=448): Delete(path='/test_snapshot_multinode_recover100', version=-1) (connection.py:312, _submit) 2026-04-29 22:47:40 [ 539 ] DEBUG : Received response(xid=448): True (connection.py:410, _read_response) 2026-04-29 22:47:40 [ 539 ] DEBUG : Sending request(xid=449): Delete(path='/test_snapshot_multinode_recover110', version=-1) (connection.py:312, _submit) 2026-04-29 22:47:40 [ 539 ] DEBUG : Received response(xid=449): True (connection.py:410, _read_response) 2026-04-29 22:47:40 [ 539 ] DEBUG : Sending request(xid=450): Delete(path='/test_snapshot_multinode_recover120', version=-1) (connection.py:312, _submit) 2026-04-29 22:47:40 [ 539 ] DEBUG : Received response(xid=450): True (connection.py:410, _read_response) 2026-04-29 22:47:40 [ 539 ] DEBUG : Sending request(xid=451): Delete(path='/test_snapshot_multinode_recover130', version=-1) (connection.py:312, _submit) 2026-04-29 22:47:40 [ 539 ] DEBUG : Received response(xid=451): True (connection.py:410, _read_response) 2026-04-29 22:47:40 [ 539 ] DEBUG : Sending request(xid=452): Delete(path='/test_snapshot_multinode_recover140', version=-1) (connection.py:312, _submit) 2026-04-29 22:47:40 [ 539 ] DEBUG : Received response(xid=452): True (connection.py:410, _read_response) 2026-04-29 22:47:40 [ 539 ] DEBUG : Sending request(xid=453): Delete(path='/test_snapshot_multinode_recover150', version=-1) (connection.py:312, _submit) 2026-04-29 22:47:40 [ 539 ] DEBUG : Received response(xid=453): True (connection.py:410, _read_response) 2026-04-29 22:47:40 [ 539 ] DEBUG : Sending request(xid=454): Delete(path='/test_snapshot_multinode_recover160', version=-1) (connection.py:312, _submit) 2026-04-29 22:47:40 [ 539 ] DEBUG : Received response(xid=454): True (connection.py:410, _read_response) 2026-04-29 22:47:40 [ 539 ] DEBUG : Sending request(xid=455): Delete(path='/test_snapshot_multinode_recover170', version=-1) (connection.py:312, _submit) 2026-04-29 22:47:40 [ 539 ] DEBUG : Received response(xid=455): True (connection.py:410, _read_response) 2026-04-29 22:47:40 [ 539 ] DEBUG : Sending request(xid=456): Delete(path='/test_snapshot_multinode_recover180', version=-1) (connection.py:312, _submit) 2026-04-29 22:47:40 [ 539 ] DEBUG : Received response(xid=456): True (connection.py:410, _read_response) 2026-04-29 22:47:40 [ 539 ] DEBUG : Sending request(xid=457): Delete(path='/test_snapshot_multinode_recover190', version=-1) (connection.py:312, _submit) 2026-04-29 22:47:40 [ 539 ] INFO : Connecting to 172.16.25.3(172.16.25.3):9181, use_ssl: False (connection.py:650, _connect) 2026-04-29 22:47:40 [ 539 ] WARNING : Connection dropped: socket connection error: Connection refused (connection.py:622, _connect_attempt) 2026-04-29 22:47:40 [ 539 ] DEBUG : Received response(xid=457): True (connection.py:410, _read_response) 2026-04-29 22:47:40 [ 539 ] DEBUG : Sending request(xid=458): Delete(path='/test_snapshot_multinode_recover200', version=-1) (connection.py:312, _submit) 2026-04-29 22:47:40 [ 539 ] DEBUG : Received response(xid=458): True (connection.py:410, _read_response) 2026-04-29 22:47:40 [ 539 ] DEBUG : Sending request(xid=459): Delete(path='/test_snapshot_multinode_recover210', version=-1) (connection.py:312, _submit) 2026-04-29 22:47:40 [ 539 ] DEBUG : Received response(xid=459): True (connection.py:410, _read_response) 2026-04-29 22:47:40 [ 539 ] DEBUG : Sending request(xid=460): Delete(path='/test_snapshot_multinode_recover220', version=-1) (connection.py:312, _submit) 2026-04-29 22:47:40 [ 539 ] DEBUG : Received response(xid=460): True (connection.py:410, _read_response) 2026-04-29 22:47:40 [ 539 ] DEBUG : Sending request(xid=461): Delete(path='/test_snapshot_multinode_recover230', version=-1) (connection.py:312, _submit) 2026-04-29 22:47:40 [ 539 ] DEBUG : Received response(xid=461): True (connection.py:410, _read_response) 2026-04-29 22:47:40 [ 539 ] DEBUG : Sending request(xid=462): Delete(path='/test_snapshot_multinode_recover240', version=-1) (connection.py:312, _submit) 2026-04-29 22:47:40 [ 539 ] DEBUG : Received response(xid=462): True (connection.py:410, _read_response) 2026-04-29 22:47:40 [ 539 ] DEBUG : Sending request(xid=463): Delete(path='/test_snapshot_multinode_recover250', version=-1) (connection.py:312, _submit) 2026-04-29 22:47:40 [ 539 ] DEBUG : Received response(xid=463): True (connection.py:410, _read_response) 2026-04-29 22:47:40 [ 539 ] DEBUG : Sending request(xid=464): Delete(path='/test_snapshot_multinode_recover260', version=-1) (connection.py:312, _submit) 2026-04-29 22:47:40 [ 539 ] DEBUG : Received response(xid=464): True (connection.py:410, _read_response) 2026-04-29 22:47:40 [ 539 ] DEBUG : Sending request(xid=465): Delete(path='/test_snapshot_multinode_recover270', version=-1) (connection.py:312, _submit) 2026-04-29 22:47:40 [ 539 ] DEBUG : Received response(xid=465): True (connection.py:410, _read_response) 2026-04-29 22:47:40 [ 539 ] DEBUG : Sending request(xid=466): Delete(path='/test_snapshot_multinode_recover280', version=-1) (connection.py:312, _submit) 2026-04-29 22:47:40 [ 539 ] DEBUG : Received response(xid=466): True (connection.py:410, _read_response) 2026-04-29 22:47:40 [ 539 ] DEBUG : Sending request(xid=467): Delete(path='/test_snapshot_multinode_recover290', version=-1) (connection.py:312, _submit) 2026-04-29 22:47:40 [ 539 ] DEBUG : Received response(xid=467): True (connection.py:410, _read_response) 2026-04-29 22:47:40 [ 539 ] DEBUG : Sending request(xid=468): Delete(path='/test_snapshot_multinode_recover300', version=-1) (connection.py:312, _submit) 2026-04-29 22:47:40 [ 539 ] DEBUG : Received response(xid=468): True (connection.py:410, _read_response) 2026-04-29 22:47:40 [ 539 ] DEBUG : Sending request(xid=469): Delete(path='/test_snapshot_multinode_recover310', version=-1) (connection.py:312, _submit) 2026-04-29 22:47:40 [ 539 ] DEBUG : Received response(xid=469): True (connection.py:410, _read_response) 2026-04-29 22:47:40 [ 539 ] DEBUG : Sending request(xid=470): Delete(path='/test_snapshot_multinode_recover320', version=-1) (connection.py:312, _submit) 2026-04-29 22:47:40 [ 539 ] DEBUG : Received response(xid=470): True (connection.py:410, _read_response) 2026-04-29 22:47:40 [ 539 ] DEBUG : Sending request(xid=471): Delete(path='/test_snapshot_multinode_recover330', version=-1) (connection.py:312, _submit) 2026-04-29 22:47:40 [ 539 ] DEBUG : Received response(xid=471): True (connection.py:410, _read_response) 2026-04-29 22:47:40 [ 539 ] DEBUG : Sending request(xid=472): Delete(path='/test_snapshot_multinode_recover340', version=-1) (connection.py:312, _submit) 2026-04-29 22:47:40 [ 539 ] DEBUG : Received response(xid=472): True (connection.py:410, _read_response) 2026-04-29 22:47:40 [ 539 ] DEBUG : Sending request(xid=473): Delete(path='/test_snapshot_multinode_recover350', version=-1) (connection.py:312, _submit) 2026-04-29 22:47:40 [ 539 ] DEBUG : Received response(xid=473): True (connection.py:410, _read_response) 2026-04-29 22:47:40 [ 539 ] DEBUG : Sending request(xid=474): Delete(path='/test_snapshot_multinode_recover360', version=-1) (connection.py:312, _submit) 2026-04-29 22:47:41 [ 539 ] DEBUG : Received response(xid=474): True (connection.py:410, _read_response) 2026-04-29 22:47:41 [ 539 ] DEBUG : Sending request(xid=475): Delete(path='/test_snapshot_multinode_recover370', version=-1) (connection.py:312, _submit) 2026-04-29 22:47:41 [ 539 ] DEBUG : Received response(xid=475): True (connection.py:410, _read_response) 2026-04-29 22:47:41 [ 539 ] DEBUG : Sending request(xid=476): Delete(path='/test_snapshot_multinode_recover380', version=-1) (connection.py:312, _submit) 2026-04-29 22:47:41 [ 539 ] DEBUG : Received response(xid=476): True (connection.py:410, _read_response) 2026-04-29 22:47:41 [ 539 ] DEBUG : Sending request(xid=477): Delete(path='/test_snapshot_multinode_recover390', version=-1) (connection.py:312, _submit) 2026-04-29 22:47:41 [ 539 ] DEBUG : Received response(xid=477): True (connection.py:410, _read_response) 2026-04-29 22:47:41 [ 539 ] DEBUG : Sending request(xid=478): Delete(path='/test_snapshot_multinode_recover400', version=-1) (connection.py:312, _submit) 2026-04-29 22:47:41 [ 539 ] DEBUG : Received response(xid=478): True (connection.py:410, _read_response) 2026-04-29 22:47:41 [ 539 ] DEBUG : Sending request(xid=479): Delete(path='/test_snapshot_multinode_recover410', version=-1) (connection.py:312, _submit) 2026-04-29 22:47:41 [ 539 ] DEBUG : Received response(xid=479): True (connection.py:410, _read_response) 2026-04-29 22:47:41 [ 539 ] DEBUG : Sending request(xid=480): Delete(path='/test_snapshot_multinode_recover420', version=-1) (connection.py:312, _submit) 2026-04-29 22:47:41 [ 539 ] DEBUG : Received response(xid=480): True (connection.py:410, _read_response) 2026-04-29 22:47:41 [ 539 ] DEBUG : Sending request(xid=481): Delete(path='/test_snapshot_multinode_recover430', version=-1) (connection.py:312, _submit) 2026-04-29 22:47:41 [ 539 ] DEBUG : Received response(xid=481): True (connection.py:410, _read_response) 2026-04-29 22:47:41 [ 539 ] DEBUG : Sending request(xid=482): Close() (connection.py:312, _submit) 2026-04-29 22:47:41 [ 539 ] WARNING : Connection dropped: socket connection broken (connection.py:622, _connect_attempt) 2026-04-29 22:47:41 [ 539 ] WARNING : Transition to CONNECTING (connection.py:626, _connect_attempt) 2026-04-29 22:47:41 [ 539 ] INFO : Zookeeper connection lost (client.py:543, _session_callback) 2026-04-29 22:47:41 [ 539 ] WARNING : Failed connecting to Zookeeper within the connection retry policy. (connection.py:515, zk_loop) 2026-04-29 22:47:41 [ 539 ] INFO : Zookeeper session closed, state: CLOSED (client.py:537, _session_callback) 2026-04-29 22:47:41 [ 539 ] DEBUG : Sending request(xid=3): Close() (connection.py:312, _submit) 2026-04-29 22:47:41 [ 539 ] WARNING : Connection dropped: socket connection broken (connection.py:622, _connect_attempt) 2026-04-29 22:47:41 [ 539 ] WARNING : Transition to CONNECTING (connection.py:626, _connect_attempt) 2026-04-29 22:47:41 [ 539 ] INFO : Zookeeper connection lost (client.py:543, _session_callback) 2026-04-29 22:47:41 [ 539 ] WARNING : Failed connecting to Zookeeper within the connection retry policy. (connection.py:515, zk_loop) 2026-04-29 22:47:41 [ 539 ] INFO : Zookeeper session closed, state: CLOSED (client.py:537, _session_callback) 2026-04-29 22:47:41 [ 539 ] WARNING : Failed connecting to Zookeeper within the connection retry policy. (connection.py:515, zk_loop) 2026-04-29 22:47:41 [ 539 ] INFO : Zookeeper session closed, state: CLOSED (client.py:537, _session_callback) 2026-04-29 22:47:41 [ 539 ] DEBUG : run container_id:roottestkeeperrestorefromsnapshot_gw9_node3_1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2173, exec_in_container) 2026-04-29 22:47:41 [ 539 ] DEBUG : Command:['docker', 'exec', 'roottestkeeperrestorefromsnapshot_gw9_node3_1', 'bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:113, run_and_check) 2026-04-29 22:47:42 [ 539 ] DEBUG : No clickhouse process running. Start new one. (cluster.py:3964, start_clickhouse) 2026-04-29 22:47:42 [ 539 ] DEBUG : run container_id:roottestkeeperrestorefromsnapshot_gw9_node3_1 detach:False nothrow:False cmd: ['bash', '-c', 'clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon'] (cluster.py:2173, exec_in_container) 2026-04-29 22:47:42 [ 539 ] DEBUG : Command:['docker', 'exec', '-u', '0', 'roottestkeeperrestorefromsnapshot_gw9_node3_1', 'bash', '-c', 'clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon'] (cluster.py:113, run_and_check) 2026-04-29 22:47:43 [ 539 ] DEBUG : run container_id:roottestkeeperrestorefromsnapshot_gw9_node3_1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2173, exec_in_container) 2026-04-29 22:47:43 [ 539 ] DEBUG : Command:['docker', 'exec', 'roottestkeeperrestorefromsnapshot_gw9_node3_1', 'bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:113, run_and_check) 2026-04-29 22:47:44 [ 539 ] DEBUG : Stdout:754 (cluster.py:121, run_and_check) 2026-04-29 22:47:44 [ 539 ] DEBUG : Clickhouse process running. (cluster.py:3975, start_clickhouse) 2026-04-29 22:47:44 [ 539 ] DEBUG : run container_id:roottestkeeperrestorefromsnapshot_gw9_node3_1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2173, exec_in_container) 2026-04-29 22:47:44 [ 539 ] DEBUG : Command:['docker', 'exec', 'roottestkeeperrestorefromsnapshot_gw9_node3_1', 'bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:113, run_and_check) 2026-04-29 22:47:45 [ 539 ] DEBUG : Stdout:754 (cluster.py:121, run_and_check) 2026-04-29 22:47:45 [ 539 ] DEBUG : Executing query select 20 on node3 (cluster.py:3602, query) 2026-04-29 22:47:45 [ 539 ] DEBUG : Executing query select 20 on node3 (cluster.py:3602, query) 2026-04-29 22:47:46 [ 539 ] DEBUG : Executing query select 20 on node3 (cluster.py:3602, query) 2026-04-29 22:47:46 [ 539 ] DEBUG : get_instance_ip instance_name=node3 (cluster.py:2135, get_instance_ip) 2026-04-29 22:47:46 [ 539 ] DEBUG : http://localhost:None "GET /v1.42/containers/roottestkeeperrestorefromsnapshot_gw9_node3_1/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-04-29 22:47:46 [ 539 ] DEBUG : get_instance_ip instance_name=node1 (cluster.py:2135, get_instance_ip) 2026-04-29 22:47:46 [ 539 ] DEBUG : http://localhost:None "GET /v1.42/containers/roottestkeeperrestorefromsnapshot_gw9_node1_1/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-04-29 22:47:46 [ 539 ] INFO : Connecting to 172.16.25.4(172.16.25.4):9181, use_ssl: False (connection.py:650, _connect) 2026-04-29 22:47:46 [ 539 ] DEBUG : Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) (connection.py:312, _submit) 2026-04-29 22:47:46 [ 539 ] INFO : Zookeeper connection established, state: CONNECTED (client.py:532, _session_callback) 2026-04-29 22:47:46 [ 539 ] DEBUG : get_instance_ip instance_name=node2 (cluster.py:2135, get_instance_ip) 2026-04-29 22:47:46 [ 539 ] DEBUG : http://localhost:None "GET /v1.42/containers/roottestkeeperrestorefromsnapshot_gw9_node2_1/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-04-29 22:47:46 [ 539 ] INFO : Connecting to 172.16.25.2(172.16.25.2):9181, use_ssl: False (connection.py:650, _connect) 2026-04-29 22:47:46 [ 539 ] DEBUG : Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) (connection.py:312, _submit) 2026-04-29 22:47:46 [ 539 ] INFO : Zookeeper connection established, state: CONNECTED (client.py:532, _session_callback) 2026-04-29 22:47:46 [ 539 ] DEBUG : get_instance_ip instance_name=node3 (cluster.py:2135, get_instance_ip) 2026-04-29 22:47:46 [ 539 ] DEBUG : http://localhost:None "GET /v1.42/containers/roottestkeeperrestorefromsnapshot_gw9_node3_1/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-04-29 22:47:46 [ 539 ] INFO : Connecting to 172.16.25.3(172.16.25.3):9181, use_ssl: False (connection.py:650, _connect) 2026-04-29 22:47:46 [ 539 ] DEBUG : Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=30000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) (connection.py:312, _submit) 2026-04-29 22:47:46 [ 539 ] INFO : Zookeeper connection established, state: CONNECTED (client.py:532, _session_callback) 2026-04-29 22:47:46 [ 539 ] DEBUG : Sending request(xid=1): Sync(path='/test_snapshot_multinode_recover') (connection.py:312, _submit) 2026-04-29 22:47:46 [ 539 ] DEBUG : Received response(xid=1): '/test_snapshot_multinode_recover' (connection.py:410, _read_response) 2026-04-29 22:47:46 [ 539 ] DEBUG : Sending request(xid=1): Sync(path='/test_snapshot_multinode_recover') (connection.py:312, _submit) 2026-04-29 22:47:46 [ 539 ] DEBUG : Received response(xid=1): '/test_snapshot_multinode_recover' (connection.py:410, _read_response) 2026-04-29 22:47:47 [ 539 ] DEBUG : Sending request(xid=1): Sync(path='/test_snapshot_multinode_recover') (connection.py:312, _submit) 2026-04-29 22:47:47 [ 539 ] DEBUG : Received response(xid=1): '/test_snapshot_multinode_recover' (connection.py:410, _read_response) 2026-04-29 22:47:47 [ 539 ] DEBUG : Sending request(xid=2): GetData(path='/test_snapshot_multinode_recover', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:47 [ 539 ] DEBUG : Received response(xid=2): (b'somedata', ZnodeStat(czxid=16, mzxid=16, ctime=1777502846384, mtime=1777502846384, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=8, numChildren=0, pzxid=16)) (connection.py:410, _read_response) 2026-04-29 22:47:47 [ 539 ] DEBUG : Sending request(xid=2): GetData(path='/test_snapshot_multinode_recover', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:47 [ 539 ] DEBUG : Received response(xid=2): (b'somedata', ZnodeStat(czxid=16, mzxid=16, ctime=1777502846384, mtime=1777502846384, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=8, numChildren=0, pzxid=16)) (connection.py:410, _read_response) 2026-04-29 22:47:47 [ 539 ] DEBUG : Sending request(xid=2): GetData(path='/test_snapshot_multinode_recover', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:47 [ 539 ] DEBUG : Received response(xid=2): (b'somedata', ZnodeStat(czxid=16, mzxid=16, ctime=1777502846384, mtime=1777502846384, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=8, numChildren=0, pzxid=16)) (connection.py:410, _read_response) 2026-04-29 22:47:47 [ 539 ] DEBUG : Sending request(xid=3): Exists(path='/test_snapshot_multinode_recover0', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:47 [ 539 ] DEBUG : Sending request(xid=3): Exists(path='/test_snapshot_multinode_recover0', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:47 [ 539 ] DEBUG : Sending request(xid=3): Exists(path='/test_snapshot_multinode_recover0', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:47 [ 539 ] DEBUG : Sending request(xid=4): GetData(path='/test_snapshot_multinode_recover1', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:47 [ 539 ] DEBUG : Received response(xid=4): (b'somedata1', ZnodeStat(czxid=33, mzxid=33, ctime=1777502848072, mtime=1777502848072, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=9, numChildren=0, pzxid=33)) (connection.py:410, _read_response) 2026-04-29 22:47:47 [ 539 ] DEBUG : Sending request(xid=4): GetData(path='/test_snapshot_multinode_recover1', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:47 [ 539 ] DEBUG : Received response(xid=4): (b'somedata1', ZnodeStat(czxid=33, mzxid=33, ctime=1777502848072, mtime=1777502848072, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=9, numChildren=0, pzxid=33)) (connection.py:410, _read_response) 2026-04-29 22:47:47 [ 539 ] DEBUG : Sending request(xid=4): GetData(path='/test_snapshot_multinode_recover1', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:47 [ 539 ] DEBUG : Received response(xid=4): (b'somedata1', ZnodeStat(czxid=33, mzxid=33, ctime=1777502848072, mtime=1777502848072, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=9, numChildren=0, pzxid=33)) (connection.py:410, _read_response) 2026-04-29 22:47:47 [ 539 ] DEBUG : Sending request(xid=5): GetData(path='/test_snapshot_multinode_recover2', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:47 [ 539 ] DEBUG : Received response(xid=5): (b'somedata2', ZnodeStat(czxid=34, mzxid=34, ctime=1777502848108, mtime=1777502848108, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=9, numChildren=0, pzxid=34)) (connection.py:410, _read_response) 2026-04-29 22:47:47 [ 539 ] DEBUG : Sending request(xid=5): GetData(path='/test_snapshot_multinode_recover2', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:47 [ 539 ] DEBUG : Received response(xid=5): (b'somedata2', ZnodeStat(czxid=34, mzxid=34, ctime=1777502848108, mtime=1777502848108, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=9, numChildren=0, pzxid=34)) (connection.py:410, _read_response) 2026-04-29 22:47:47 [ 539 ] DEBUG : Sending request(xid=5): GetData(path='/test_snapshot_multinode_recover2', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:47 [ 539 ] DEBUG : Received response(xid=5): (b'somedata2', ZnodeStat(czxid=34, mzxid=34, ctime=1777502848108, mtime=1777502848108, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=9, numChildren=0, pzxid=34)) (connection.py:410, _read_response) 2026-04-29 22:47:47 [ 539 ] DEBUG : Sending request(xid=6): GetData(path='/test_snapshot_multinode_recover3', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:47 [ 539 ] DEBUG : Received response(xid=6): (b'somedata3', ZnodeStat(czxid=35, mzxid=35, ctime=1777502848126, mtime=1777502848126, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=9, numChildren=0, pzxid=35)) (connection.py:410, _read_response) 2026-04-29 22:47:47 [ 539 ] DEBUG : Sending request(xid=6): GetData(path='/test_snapshot_multinode_recover3', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:47 [ 539 ] DEBUG : Received response(xid=6): (b'somedata3', ZnodeStat(czxid=35, mzxid=35, ctime=1777502848126, mtime=1777502848126, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=9, numChildren=0, pzxid=35)) (connection.py:410, _read_response) 2026-04-29 22:47:47 [ 539 ] DEBUG : Sending request(xid=6): GetData(path='/test_snapshot_multinode_recover3', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:47 [ 539 ] DEBUG : Received response(xid=6): (b'somedata3', ZnodeStat(czxid=35, mzxid=35, ctime=1777502848126, mtime=1777502848126, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=9, numChildren=0, pzxid=35)) (connection.py:410, _read_response) 2026-04-29 22:47:47 [ 539 ] DEBUG : Sending request(xid=7): GetData(path='/test_snapshot_multinode_recover4', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:47 [ 539 ] DEBUG : Received response(xid=7): (b'somedata4', ZnodeStat(czxid=36, mzxid=36, ctime=1777502848144, mtime=1777502848144, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=9, numChildren=0, pzxid=36)) (connection.py:410, _read_response) 2026-04-29 22:47:47 [ 539 ] DEBUG : Sending request(xid=7): GetData(path='/test_snapshot_multinode_recover4', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:47 [ 539 ] DEBUG : Received response(xid=7): (b'somedata4', ZnodeStat(czxid=36, mzxid=36, ctime=1777502848144, mtime=1777502848144, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=9, numChildren=0, pzxid=36)) (connection.py:410, _read_response) 2026-04-29 22:47:47 [ 539 ] DEBUG : Sending request(xid=7): GetData(path='/test_snapshot_multinode_recover4', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:47 [ 539 ] DEBUG : Received response(xid=7): (b'somedata4', ZnodeStat(czxid=36, mzxid=36, ctime=1777502848144, mtime=1777502848144, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=9, numChildren=0, pzxid=36)) (connection.py:410, _read_response) 2026-04-29 22:47:47 [ 539 ] DEBUG : Sending request(xid=8): GetData(path='/test_snapshot_multinode_recover5', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:47 [ 539 ] DEBUG : Received response(xid=8): (b'somedata5', ZnodeStat(czxid=37, mzxid=37, ctime=1777502848161, mtime=1777502848161, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=9, numChildren=0, pzxid=37)) (connection.py:410, _read_response) 2026-04-29 22:47:47 [ 539 ] DEBUG : Sending request(xid=8): GetData(path='/test_snapshot_multinode_recover5', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:47 [ 539 ] DEBUG : Received response(xid=8): (b'somedata5', ZnodeStat(czxid=37, mzxid=37, ctime=1777502848161, mtime=1777502848161, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=9, numChildren=0, pzxid=37)) (connection.py:410, _read_response) 2026-04-29 22:47:47 [ 539 ] DEBUG : Sending request(xid=8): GetData(path='/test_snapshot_multinode_recover5', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:47 [ 539 ] DEBUG : Received response(xid=8): (b'somedata5', ZnodeStat(czxid=37, mzxid=37, ctime=1777502848161, mtime=1777502848161, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=9, numChildren=0, pzxid=37)) (connection.py:410, _read_response) 2026-04-29 22:47:47 [ 539 ] DEBUG : Sending request(xid=9): GetData(path='/test_snapshot_multinode_recover6', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:47 [ 539 ] DEBUG : Received response(xid=9): (b'somedata6', ZnodeStat(czxid=38, mzxid=38, ctime=1777502848189, mtime=1777502848189, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=9, numChildren=0, pzxid=38)) (connection.py:410, _read_response) 2026-04-29 22:47:47 [ 539 ] DEBUG : Sending request(xid=9): GetData(path='/test_snapshot_multinode_recover6', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:47 [ 539 ] DEBUG : Received response(xid=9): (b'somedata6', ZnodeStat(czxid=38, mzxid=38, ctime=1777502848189, mtime=1777502848189, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=9, numChildren=0, pzxid=38)) (connection.py:410, _read_response) 2026-04-29 22:47:47 [ 539 ] DEBUG : Sending request(xid=9): GetData(path='/test_snapshot_multinode_recover6', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:47 [ 539 ] DEBUG : Received response(xid=9): (b'somedata6', ZnodeStat(czxid=38, mzxid=38, ctime=1777502848189, mtime=1777502848189, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=9, numChildren=0, pzxid=38)) (connection.py:410, _read_response) 2026-04-29 22:47:47 [ 539 ] DEBUG : Sending request(xid=10): GetData(path='/test_snapshot_multinode_recover7', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:47 [ 539 ] DEBUG : Received response(xid=10): (b'somedata7', ZnodeStat(czxid=39, mzxid=39, ctime=1777502848210, mtime=1777502848210, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=9, numChildren=0, pzxid=39)) (connection.py:410, _read_response) 2026-04-29 22:47:47 [ 539 ] DEBUG : Sending request(xid=10): GetData(path='/test_snapshot_multinode_recover7', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:47 [ 539 ] DEBUG : Received response(xid=10): (b'somedata7', ZnodeStat(czxid=39, mzxid=39, ctime=1777502848210, mtime=1777502848210, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=9, numChildren=0, pzxid=39)) (connection.py:410, _read_response) 2026-04-29 22:47:47 [ 539 ] DEBUG : Sending request(xid=10): GetData(path='/test_snapshot_multinode_recover7', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:47 [ 539 ] DEBUG : Received response(xid=10): (b'somedata7', ZnodeStat(czxid=39, mzxid=39, ctime=1777502848210, mtime=1777502848210, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=9, numChildren=0, pzxid=39)) (connection.py:410, _read_response) 2026-04-29 22:47:47 [ 539 ] DEBUG : Sending request(xid=11): GetData(path='/test_snapshot_multinode_recover8', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:47 [ 539 ] DEBUG : Received response(xid=11): (b'somedata8', ZnodeStat(czxid=40, mzxid=40, ctime=1777502848228, mtime=1777502848228, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=9, numChildren=0, pzxid=40)) (connection.py:410, _read_response) 2026-04-29 22:47:47 [ 539 ] DEBUG : Sending request(xid=11): GetData(path='/test_snapshot_multinode_recover8', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:47 [ 539 ] DEBUG : Received response(xid=11): (b'somedata8', ZnodeStat(czxid=40, mzxid=40, ctime=1777502848228, mtime=1777502848228, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=9, numChildren=0, pzxid=40)) (connection.py:410, _read_response) 2026-04-29 22:47:47 [ 539 ] DEBUG : Sending request(xid=11): GetData(path='/test_snapshot_multinode_recover8', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:47 [ 539 ] DEBUG : Received response(xid=11): (b'somedata8', ZnodeStat(czxid=40, mzxid=40, ctime=1777502848228, mtime=1777502848228, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=9, numChildren=0, pzxid=40)) (connection.py:410, _read_response) 2026-04-29 22:47:47 [ 539 ] DEBUG : Sending request(xid=12): GetData(path='/test_snapshot_multinode_recover9', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:47 [ 539 ] DEBUG : Received response(xid=12): (b'somedata9', ZnodeStat(czxid=41, mzxid=41, ctime=1777502848257, mtime=1777502848257, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=9, numChildren=0, pzxid=41)) (connection.py:410, _read_response) 2026-04-29 22:47:47 [ 539 ] DEBUG : Sending request(xid=12): GetData(path='/test_snapshot_multinode_recover9', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:47 [ 539 ] DEBUG : Received response(xid=12): (b'somedata9', ZnodeStat(czxid=41, mzxid=41, ctime=1777502848257, mtime=1777502848257, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=9, numChildren=0, pzxid=41)) (connection.py:410, _read_response) 2026-04-29 22:47:47 [ 539 ] DEBUG : Sending request(xid=12): GetData(path='/test_snapshot_multinode_recover9', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:47 [ 539 ] DEBUG : Received response(xid=12): (b'somedata9', ZnodeStat(czxid=41, mzxid=41, ctime=1777502848257, mtime=1777502848257, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=9, numChildren=0, pzxid=41)) (connection.py:410, _read_response) 2026-04-29 22:47:47 [ 539 ] DEBUG : Sending request(xid=13): Exists(path='/test_snapshot_multinode_recover10', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:47 [ 539 ] DEBUG : Sending request(xid=13): Exists(path='/test_snapshot_multinode_recover10', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:47 [ 539 ] DEBUG : Sending request(xid=13): Exists(path='/test_snapshot_multinode_recover10', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:47 [ 539 ] DEBUG : Sending request(xid=14): GetData(path='/test_snapshot_multinode_recover11', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:47 [ 539 ] DEBUG : Received response(xid=14): (b'somedata11', ZnodeStat(czxid=43, mzxid=43, ctime=1777502848286, mtime=1777502848286, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=43)) (connection.py:410, _read_response) 2026-04-29 22:47:47 [ 539 ] DEBUG : Sending request(xid=14): GetData(path='/test_snapshot_multinode_recover11', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:47 [ 539 ] DEBUG : Received response(xid=14): (b'somedata11', ZnodeStat(czxid=43, mzxid=43, ctime=1777502848286, mtime=1777502848286, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=43)) (connection.py:410, _read_response) 2026-04-29 22:47:47 [ 539 ] DEBUG : Sending request(xid=14): GetData(path='/test_snapshot_multinode_recover11', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:47 [ 539 ] DEBUG : Received response(xid=14): (b'somedata11', ZnodeStat(czxid=43, mzxid=43, ctime=1777502848286, mtime=1777502848286, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=43)) (connection.py:410, _read_response) 2026-04-29 22:47:47 [ 539 ] DEBUG : Sending request(xid=15): GetData(path='/test_snapshot_multinode_recover12', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:47 [ 539 ] DEBUG : Received response(xid=15): (b'somedata12', ZnodeStat(czxid=44, mzxid=44, ctime=1777502848304, mtime=1777502848304, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=44)) (connection.py:410, _read_response) 2026-04-29 22:47:47 [ 539 ] DEBUG : Sending request(xid=15): GetData(path='/test_snapshot_multinode_recover12', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:47 [ 539 ] DEBUG : Received response(xid=15): (b'somedata12', ZnodeStat(czxid=44, mzxid=44, ctime=1777502848304, mtime=1777502848304, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=44)) (connection.py:410, _read_response) 2026-04-29 22:47:47 [ 539 ] DEBUG : Sending request(xid=15): GetData(path='/test_snapshot_multinode_recover12', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:47 [ 539 ] DEBUG : Received response(xid=15): (b'somedata12', ZnodeStat(czxid=44, mzxid=44, ctime=1777502848304, mtime=1777502848304, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=44)) (connection.py:410, _read_response) 2026-04-29 22:47:47 [ 539 ] DEBUG : Sending request(xid=16): GetData(path='/test_snapshot_multinode_recover13', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:47 [ 539 ] DEBUG : Received response(xid=16): (b'somedata13', ZnodeStat(czxid=45, mzxid=45, ctime=1777502848325, mtime=1777502848325, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=45)) (connection.py:410, _read_response) 2026-04-29 22:47:47 [ 539 ] DEBUG : Sending request(xid=16): GetData(path='/test_snapshot_multinode_recover13', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:47 [ 539 ] DEBUG : Received response(xid=16): (b'somedata13', ZnodeStat(czxid=45, mzxid=45, ctime=1777502848325, mtime=1777502848325, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=45)) (connection.py:410, _read_response) 2026-04-29 22:47:47 [ 539 ] DEBUG : Sending request(xid=16): GetData(path='/test_snapshot_multinode_recover13', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:47 [ 539 ] DEBUG : Received response(xid=16): (b'somedata13', ZnodeStat(czxid=45, mzxid=45, ctime=1777502848325, mtime=1777502848325, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=45)) (connection.py:410, _read_response) 2026-04-29 22:47:47 [ 539 ] DEBUG : Sending request(xid=17): GetData(path='/test_snapshot_multinode_recover14', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:47 [ 539 ] DEBUG : Received response(xid=17): (b'somedata14', ZnodeStat(czxid=46, mzxid=46, ctime=1777502848341, mtime=1777502848341, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=46)) (connection.py:410, _read_response) 2026-04-29 22:47:47 [ 539 ] DEBUG : Sending request(xid=17): GetData(path='/test_snapshot_multinode_recover14', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:47 [ 539 ] DEBUG : Received response(xid=17): (b'somedata14', ZnodeStat(czxid=46, mzxid=46, ctime=1777502848341, mtime=1777502848341, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=46)) (connection.py:410, _read_response) 2026-04-29 22:47:47 [ 539 ] DEBUG : Sending request(xid=17): GetData(path='/test_snapshot_multinode_recover14', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:47 [ 539 ] DEBUG : Received response(xid=17): (b'somedata14', ZnodeStat(czxid=46, mzxid=46, ctime=1777502848341, mtime=1777502848341, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=46)) (connection.py:410, _read_response) 2026-04-29 22:47:47 [ 539 ] DEBUG : Sending request(xid=18): GetData(path='/test_snapshot_multinode_recover15', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:47 [ 539 ] DEBUG : Received response(xid=18): (b'somedata15', ZnodeStat(czxid=47, mzxid=47, ctime=1777502848373, mtime=1777502848373, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=47)) (connection.py:410, _read_response) 2026-04-29 22:47:47 [ 539 ] DEBUG : Sending request(xid=18): GetData(path='/test_snapshot_multinode_recover15', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:47 [ 539 ] DEBUG : Received response(xid=18): (b'somedata15', ZnodeStat(czxid=47, mzxid=47, ctime=1777502848373, mtime=1777502848373, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=47)) (connection.py:410, _read_response) 2026-04-29 22:47:47 [ 539 ] DEBUG : Sending request(xid=18): GetData(path='/test_snapshot_multinode_recover15', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:47 [ 539 ] DEBUG : Received response(xid=18): (b'somedata15', ZnodeStat(czxid=47, mzxid=47, ctime=1777502848373, mtime=1777502848373, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=47)) (connection.py:410, _read_response) 2026-04-29 22:47:47 [ 539 ] DEBUG : Sending request(xid=19): GetData(path='/test_snapshot_multinode_recover16', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:47 [ 539 ] DEBUG : Received response(xid=19): (b'somedata16', ZnodeStat(czxid=48, mzxid=48, ctime=1777502848399, mtime=1777502848399, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=48)) (connection.py:410, _read_response) 2026-04-29 22:47:47 [ 539 ] DEBUG : Sending request(xid=19): GetData(path='/test_snapshot_multinode_recover16', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:47 [ 539 ] DEBUG : Received response(xid=19): (b'somedata16', ZnodeStat(czxid=48, mzxid=48, ctime=1777502848399, mtime=1777502848399, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=48)) (connection.py:410, _read_response) 2026-04-29 22:47:47 [ 539 ] DEBUG : Sending request(xid=19): GetData(path='/test_snapshot_multinode_recover16', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:47 [ 539 ] DEBUG : Received response(xid=19): (b'somedata16', ZnodeStat(czxid=48, mzxid=48, ctime=1777502848399, mtime=1777502848399, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=48)) (connection.py:410, _read_response) 2026-04-29 22:47:47 [ 539 ] DEBUG : Sending request(xid=20): GetData(path='/test_snapshot_multinode_recover17', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:47 [ 539 ] DEBUG : Received response(xid=20): (b'somedata17', ZnodeStat(czxid=49, mzxid=49, ctime=1777502848424, mtime=1777502848424, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=49)) (connection.py:410, _read_response) 2026-04-29 22:47:47 [ 539 ] DEBUG : Sending request(xid=20): GetData(path='/test_snapshot_multinode_recover17', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:47 [ 539 ] DEBUG : Received response(xid=20): (b'somedata17', ZnodeStat(czxid=49, mzxid=49, ctime=1777502848424, mtime=1777502848424, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=49)) (connection.py:410, _read_response) 2026-04-29 22:47:47 [ 539 ] DEBUG : Sending request(xid=20): GetData(path='/test_snapshot_multinode_recover17', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:47 [ 539 ] DEBUG : Received response(xid=20): (b'somedata17', ZnodeStat(czxid=49, mzxid=49, ctime=1777502848424, mtime=1777502848424, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=49)) (connection.py:410, _read_response) 2026-04-29 22:47:47 [ 539 ] DEBUG : Sending request(xid=21): GetData(path='/test_snapshot_multinode_recover18', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:47 [ 539 ] DEBUG : Received response(xid=21): (b'somedata18', ZnodeStat(czxid=50, mzxid=50, ctime=1777502848445, mtime=1777502848445, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=50)) (connection.py:410, _read_response) 2026-04-29 22:47:47 [ 539 ] DEBUG : Sending request(xid=21): GetData(path='/test_snapshot_multinode_recover18', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:47 [ 539 ] DEBUG : Received response(xid=21): (b'somedata18', ZnodeStat(czxid=50, mzxid=50, ctime=1777502848445, mtime=1777502848445, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=50)) (connection.py:410, _read_response) 2026-04-29 22:47:47 [ 539 ] DEBUG : Sending request(xid=21): GetData(path='/test_snapshot_multinode_recover18', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:47 [ 539 ] DEBUG : Received response(xid=21): (b'somedata18', ZnodeStat(czxid=50, mzxid=50, ctime=1777502848445, mtime=1777502848445, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=50)) (connection.py:410, _read_response) 2026-04-29 22:47:47 [ 539 ] DEBUG : Sending request(xid=22): GetData(path='/test_snapshot_multinode_recover19', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:47 [ 539 ] DEBUG : Received response(xid=22): (b'somedata19', ZnodeStat(czxid=51, mzxid=51, ctime=1777502848477, mtime=1777502848477, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=51)) (connection.py:410, _read_response) 2026-04-29 22:47:47 [ 539 ] DEBUG : Sending request(xid=22): GetData(path='/test_snapshot_multinode_recover19', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:47 [ 539 ] DEBUG : Received response(xid=22): (b'somedata19', ZnodeStat(czxid=51, mzxid=51, ctime=1777502848477, mtime=1777502848477, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=51)) (connection.py:410, _read_response) 2026-04-29 22:47:47 [ 539 ] DEBUG : Sending request(xid=22): GetData(path='/test_snapshot_multinode_recover19', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:47 [ 539 ] DEBUG : Received response(xid=22): (b'somedata19', ZnodeStat(czxid=51, mzxid=51, ctime=1777502848477, mtime=1777502848477, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=51)) (connection.py:410, _read_response) 2026-04-29 22:47:47 [ 539 ] DEBUG : Sending request(xid=23): Exists(path='/test_snapshot_multinode_recover20', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:47 [ 539 ] DEBUG : Sending request(xid=23): Exists(path='/test_snapshot_multinode_recover20', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:47 [ 539 ] DEBUG : Sending request(xid=23): Exists(path='/test_snapshot_multinode_recover20', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:47 [ 539 ] DEBUG : Sending request(xid=24): GetData(path='/test_snapshot_multinode_recover21', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:47 [ 539 ] DEBUG : Received response(xid=24): (b'somedata21', ZnodeStat(czxid=53, mzxid=53, ctime=1777502848531, mtime=1777502848531, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=53)) (connection.py:410, _read_response) 2026-04-29 22:47:48 [ 539 ] DEBUG : Sending request(xid=24): GetData(path='/test_snapshot_multinode_recover21', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:48 [ 539 ] DEBUG : Received response(xid=24): (b'somedata21', ZnodeStat(czxid=53, mzxid=53, ctime=1777502848531, mtime=1777502848531, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=53)) (connection.py:410, _read_response) 2026-04-29 22:47:48 [ 539 ] DEBUG : Sending request(xid=24): GetData(path='/test_snapshot_multinode_recover21', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:48 [ 539 ] DEBUG : Received response(xid=24): (b'somedata21', ZnodeStat(czxid=53, mzxid=53, ctime=1777502848531, mtime=1777502848531, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=53)) (connection.py:410, _read_response) 2026-04-29 22:47:48 [ 539 ] DEBUG : Sending request(xid=25): GetData(path='/test_snapshot_multinode_recover22', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:48 [ 539 ] DEBUG : Received response(xid=25): (b'somedata22', ZnodeStat(czxid=54, mzxid=54, ctime=1777502848546, mtime=1777502848546, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=54)) (connection.py:410, _read_response) 2026-04-29 22:47:48 [ 539 ] DEBUG : Sending request(xid=25): GetData(path='/test_snapshot_multinode_recover22', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:48 [ 539 ] DEBUG : Received response(xid=25): (b'somedata22', ZnodeStat(czxid=54, mzxid=54, ctime=1777502848546, mtime=1777502848546, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=54)) (connection.py:410, _read_response) 2026-04-29 22:47:48 [ 539 ] DEBUG : Sending request(xid=25): GetData(path='/test_snapshot_multinode_recover22', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:48 [ 539 ] DEBUG : Received response(xid=25): (b'somedata22', ZnodeStat(czxid=54, mzxid=54, ctime=1777502848546, mtime=1777502848546, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=54)) (connection.py:410, _read_response) 2026-04-29 22:47:48 [ 539 ] DEBUG : Sending request(xid=26): GetData(path='/test_snapshot_multinode_recover23', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:48 [ 539 ] DEBUG : Received response(xid=26): (b'somedata23', ZnodeStat(czxid=55, mzxid=55, ctime=1777502848562, mtime=1777502848562, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=55)) (connection.py:410, _read_response) 2026-04-29 22:47:48 [ 539 ] DEBUG : Sending request(xid=26): GetData(path='/test_snapshot_multinode_recover23', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:48 [ 539 ] DEBUG : Received response(xid=26): (b'somedata23', ZnodeStat(czxid=55, mzxid=55, ctime=1777502848562, mtime=1777502848562, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=55)) (connection.py:410, _read_response) 2026-04-29 22:47:48 [ 539 ] DEBUG : Sending request(xid=26): GetData(path='/test_snapshot_multinode_recover23', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:48 [ 539 ] DEBUG : Received response(xid=26): (b'somedata23', ZnodeStat(czxid=55, mzxid=55, ctime=1777502848562, mtime=1777502848562, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=55)) (connection.py:410, _read_response) 2026-04-29 22:47:48 [ 539 ] DEBUG : Sending request(xid=27): GetData(path='/test_snapshot_multinode_recover24', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:48 [ 539 ] DEBUG : Received response(xid=27): (b'somedata24', ZnodeStat(czxid=56, mzxid=56, ctime=1777502848573, mtime=1777502848573, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=56)) (connection.py:410, _read_response) 2026-04-29 22:47:48 [ 539 ] DEBUG : Sending request(xid=27): GetData(path='/test_snapshot_multinode_recover24', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:48 [ 539 ] DEBUG : Received response(xid=27): (b'somedata24', ZnodeStat(czxid=56, mzxid=56, ctime=1777502848573, mtime=1777502848573, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=56)) (connection.py:410, _read_response) 2026-04-29 22:47:48 [ 539 ] DEBUG : Sending request(xid=27): GetData(path='/test_snapshot_multinode_recover24', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:48 [ 539 ] DEBUG : Received response(xid=27): (b'somedata24', ZnodeStat(czxid=56, mzxid=56, ctime=1777502848573, mtime=1777502848573, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=56)) (connection.py:410, _read_response) 2026-04-29 22:47:48 [ 539 ] DEBUG : Sending request(xid=28): GetData(path='/test_snapshot_multinode_recover25', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:48 [ 539 ] DEBUG : Received response(xid=28): (b'somedata25', ZnodeStat(czxid=57, mzxid=57, ctime=1777502848591, mtime=1777502848591, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=57)) (connection.py:410, _read_response) 2026-04-29 22:47:48 [ 539 ] DEBUG : Sending request(xid=28): GetData(path='/test_snapshot_multinode_recover25', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:48 [ 539 ] DEBUG : Received response(xid=28): (b'somedata25', ZnodeStat(czxid=57, mzxid=57, ctime=1777502848591, mtime=1777502848591, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=57)) (connection.py:410, _read_response) 2026-04-29 22:47:48 [ 539 ] DEBUG : Sending request(xid=28): GetData(path='/test_snapshot_multinode_recover25', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:48 [ 539 ] DEBUG : Received response(xid=28): (b'somedata25', ZnodeStat(czxid=57, mzxid=57, ctime=1777502848591, mtime=1777502848591, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=57)) (connection.py:410, _read_response) 2026-04-29 22:47:48 [ 539 ] DEBUG : Sending request(xid=29): GetData(path='/test_snapshot_multinode_recover26', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:48 [ 539 ] DEBUG : Received response(xid=29): (b'somedata26', ZnodeStat(czxid=58, mzxid=58, ctime=1777502848610, mtime=1777502848610, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=58)) (connection.py:410, _read_response) 2026-04-29 22:47:48 [ 539 ] DEBUG : Sending request(xid=29): GetData(path='/test_snapshot_multinode_recover26', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:48 [ 539 ] DEBUG : Received response(xid=29): (b'somedata26', ZnodeStat(czxid=58, mzxid=58, ctime=1777502848610, mtime=1777502848610, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=58)) (connection.py:410, _read_response) 2026-04-29 22:47:48 [ 539 ] DEBUG : Sending request(xid=29): GetData(path='/test_snapshot_multinode_recover26', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:48 [ 539 ] DEBUG : Received response(xid=29): (b'somedata26', ZnodeStat(czxid=58, mzxid=58, ctime=1777502848610, mtime=1777502848610, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=58)) (connection.py:410, _read_response) 2026-04-29 22:47:48 [ 539 ] DEBUG : Sending request(xid=30): GetData(path='/test_snapshot_multinode_recover27', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:48 [ 539 ] DEBUG : Received response(xid=30): (b'somedata27', ZnodeStat(czxid=59, mzxid=59, ctime=1777502848625, mtime=1777502848625, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=59)) (connection.py:410, _read_response) 2026-04-29 22:47:48 [ 539 ] DEBUG : Sending request(xid=30): GetData(path='/test_snapshot_multinode_recover27', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:48 [ 539 ] DEBUG : Received response(xid=30): (b'somedata27', ZnodeStat(czxid=59, mzxid=59, ctime=1777502848625, mtime=1777502848625, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=59)) (connection.py:410, _read_response) 2026-04-29 22:47:48 [ 539 ] DEBUG : Sending request(xid=30): GetData(path='/test_snapshot_multinode_recover27', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:48 [ 539 ] DEBUG : Received response(xid=30): (b'somedata27', ZnodeStat(czxid=59, mzxid=59, ctime=1777502848625, mtime=1777502848625, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=59)) (connection.py:410, _read_response) 2026-04-29 22:47:48 [ 539 ] DEBUG : Sending request(xid=31): GetData(path='/test_snapshot_multinode_recover28', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:48 [ 539 ] DEBUG : Received response(xid=31): (b'somedata28', ZnodeStat(czxid=60, mzxid=60, ctime=1777502848647, mtime=1777502848647, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=60)) (connection.py:410, _read_response) 2026-04-29 22:47:48 [ 539 ] DEBUG : Sending request(xid=31): GetData(path='/test_snapshot_multinode_recover28', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:48 [ 539 ] DEBUG : Received response(xid=31): (b'somedata28', ZnodeStat(czxid=60, mzxid=60, ctime=1777502848647, mtime=1777502848647, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=60)) (connection.py:410, _read_response) 2026-04-29 22:47:48 [ 539 ] DEBUG : Sending request(xid=31): GetData(path='/test_snapshot_multinode_recover28', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:48 [ 539 ] DEBUG : Received response(xid=31): (b'somedata28', ZnodeStat(czxid=60, mzxid=60, ctime=1777502848647, mtime=1777502848647, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=60)) (connection.py:410, _read_response) 2026-04-29 22:47:48 [ 539 ] DEBUG : Sending request(xid=32): GetData(path='/test_snapshot_multinode_recover29', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:48 [ 539 ] DEBUG : Received response(xid=32): (b'somedata29', ZnodeStat(czxid=61, mzxid=61, ctime=1777502848666, mtime=1777502848666, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=61)) (connection.py:410, _read_response) 2026-04-29 22:47:48 [ 539 ] DEBUG : Sending request(xid=32): GetData(path='/test_snapshot_multinode_recover29', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:48 [ 539 ] DEBUG : Received response(xid=32): (b'somedata29', ZnodeStat(czxid=61, mzxid=61, ctime=1777502848666, mtime=1777502848666, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=61)) (connection.py:410, _read_response) 2026-04-29 22:47:48 [ 539 ] DEBUG : Sending request(xid=32): GetData(path='/test_snapshot_multinode_recover29', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:48 [ 539 ] DEBUG : Received response(xid=32): (b'somedata29', ZnodeStat(czxid=61, mzxid=61, ctime=1777502848666, mtime=1777502848666, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=61)) (connection.py:410, _read_response) 2026-04-29 22:47:48 [ 539 ] DEBUG : Sending request(xid=33): Exists(path='/test_snapshot_multinode_recover30', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:48 [ 539 ] DEBUG : Sending request(xid=33): Exists(path='/test_snapshot_multinode_recover30', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:48 [ 539 ] DEBUG : Sending request(xid=33): Exists(path='/test_snapshot_multinode_recover30', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:48 [ 539 ] DEBUG : Sending request(xid=34): GetData(path='/test_snapshot_multinode_recover31', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:48 [ 539 ] DEBUG : Received response(xid=34): (b'somedata31', ZnodeStat(czxid=63, mzxid=63, ctime=1777502848713, mtime=1777502848713, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=63)) (connection.py:410, _read_response) 2026-04-29 22:47:48 [ 539 ] DEBUG : Sending request(xid=34): GetData(path='/test_snapshot_multinode_recover31', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:48 [ 539 ] DEBUG : Received response(xid=34): (b'somedata31', ZnodeStat(czxid=63, mzxid=63, ctime=1777502848713, mtime=1777502848713, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=63)) (connection.py:410, _read_response) 2026-04-29 22:47:48 [ 539 ] DEBUG : Sending request(xid=34): GetData(path='/test_snapshot_multinode_recover31', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:48 [ 539 ] DEBUG : Received response(xid=34): (b'somedata31', ZnodeStat(czxid=63, mzxid=63, ctime=1777502848713, mtime=1777502848713, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=63)) (connection.py:410, _read_response) 2026-04-29 22:47:48 [ 539 ] DEBUG : Sending request(xid=35): GetData(path='/test_snapshot_multinode_recover32', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:48 [ 539 ] DEBUG : Received response(xid=35): (b'somedata32', ZnodeStat(czxid=64, mzxid=64, ctime=1777502848746, mtime=1777502848746, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=64)) (connection.py:410, _read_response) 2026-04-29 22:47:48 [ 539 ] DEBUG : Sending request(xid=35): GetData(path='/test_snapshot_multinode_recover32', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:48 [ 539 ] DEBUG : Received response(xid=35): (b'somedata32', ZnodeStat(czxid=64, mzxid=64, ctime=1777502848746, mtime=1777502848746, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=64)) (connection.py:410, _read_response) 2026-04-29 22:47:48 [ 539 ] DEBUG : Sending request(xid=35): GetData(path='/test_snapshot_multinode_recover32', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:48 [ 539 ] DEBUG : Received response(xid=35): (b'somedata32', ZnodeStat(czxid=64, mzxid=64, ctime=1777502848746, mtime=1777502848746, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=64)) (connection.py:410, _read_response) 2026-04-29 22:47:48 [ 539 ] DEBUG : Sending request(xid=36): GetData(path='/test_snapshot_multinode_recover33', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:48 [ 539 ] DEBUG : Received response(xid=36): (b'somedata33', ZnodeStat(czxid=66, mzxid=66, ctime=1777502848761, mtime=1777502848761, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=66)) (connection.py:410, _read_response) 2026-04-29 22:47:48 [ 539 ] DEBUG : Sending request(xid=36): GetData(path='/test_snapshot_multinode_recover33', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:48 [ 539 ] DEBUG : Received response(xid=36): (b'somedata33', ZnodeStat(czxid=66, mzxid=66, ctime=1777502848761, mtime=1777502848761, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=66)) (connection.py:410, _read_response) 2026-04-29 22:47:48 [ 539 ] DEBUG : Sending request(xid=36): GetData(path='/test_snapshot_multinode_recover33', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:48 [ 539 ] DEBUG : Received response(xid=36): (b'somedata33', ZnodeStat(czxid=66, mzxid=66, ctime=1777502848761, mtime=1777502848761, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=66)) (connection.py:410, _read_response) 2026-04-29 22:47:48 [ 539 ] DEBUG : Sending request(xid=37): GetData(path='/test_snapshot_multinode_recover34', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:48 [ 539 ] DEBUG : Received response(xid=37): (b'somedata34', ZnodeStat(czxid=68, mzxid=68, ctime=1777502848776, mtime=1777502848776, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=68)) (connection.py:410, _read_response) 2026-04-29 22:47:48 [ 539 ] DEBUG : Sending request(xid=37): GetData(path='/test_snapshot_multinode_recover34', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:48 [ 539 ] DEBUG : Received response(xid=37): (b'somedata34', ZnodeStat(czxid=68, mzxid=68, ctime=1777502848776, mtime=1777502848776, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=68)) (connection.py:410, _read_response) 2026-04-29 22:47:48 [ 539 ] DEBUG : Sending request(xid=37): GetData(path='/test_snapshot_multinode_recover34', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:48 [ 539 ] DEBUG : Received response(xid=37): (b'somedata34', ZnodeStat(czxid=68, mzxid=68, ctime=1777502848776, mtime=1777502848776, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=68)) (connection.py:410, _read_response) 2026-04-29 22:47:48 [ 539 ] DEBUG : Sending request(xid=38): GetData(path='/test_snapshot_multinode_recover35', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:48 [ 539 ] DEBUG : Received response(xid=38): (b'somedata35', ZnodeStat(czxid=69, mzxid=69, ctime=1777502848798, mtime=1777502848798, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=69)) (connection.py:410, _read_response) 2026-04-29 22:47:48 [ 539 ] DEBUG : Sending request(xid=38): GetData(path='/test_snapshot_multinode_recover35', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:48 [ 539 ] DEBUG : Received response(xid=38): (b'somedata35', ZnodeStat(czxid=69, mzxid=69, ctime=1777502848798, mtime=1777502848798, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=69)) (connection.py:410, _read_response) 2026-04-29 22:47:48 [ 539 ] DEBUG : Sending request(xid=38): GetData(path='/test_snapshot_multinode_recover35', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:48 [ 539 ] DEBUG : Received response(xid=38): (b'somedata35', ZnodeStat(czxid=69, mzxid=69, ctime=1777502848798, mtime=1777502848798, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=69)) (connection.py:410, _read_response) 2026-04-29 22:47:48 [ 539 ] DEBUG : Sending request(xid=39): GetData(path='/test_snapshot_multinode_recover36', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:48 [ 539 ] DEBUG : Received response(xid=39): (b'somedata36', ZnodeStat(czxid=70, mzxid=70, ctime=1777502848819, mtime=1777502848819, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=70)) (connection.py:410, _read_response) 2026-04-29 22:47:48 [ 539 ] DEBUG : Sending request(xid=39): GetData(path='/test_snapshot_multinode_recover36', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:48 [ 539 ] DEBUG : Received response(xid=39): (b'somedata36', ZnodeStat(czxid=70, mzxid=70, ctime=1777502848819, mtime=1777502848819, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=70)) (connection.py:410, _read_response) 2026-04-29 22:47:48 [ 539 ] DEBUG : Sending request(xid=39): GetData(path='/test_snapshot_multinode_recover36', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:48 [ 539 ] DEBUG : Received response(xid=39): (b'somedata36', ZnodeStat(czxid=70, mzxid=70, ctime=1777502848819, mtime=1777502848819, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=70)) (connection.py:410, _read_response) 2026-04-29 22:47:48 [ 539 ] DEBUG : Sending request(xid=40): GetData(path='/test_snapshot_multinode_recover37', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:48 [ 539 ] DEBUG : Received response(xid=40): (b'somedata37', ZnodeStat(czxid=71, mzxid=71, ctime=1777502848835, mtime=1777502848835, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=71)) (connection.py:410, _read_response) 2026-04-29 22:47:48 [ 539 ] DEBUG : Sending request(xid=40): GetData(path='/test_snapshot_multinode_recover37', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:48 [ 539 ] DEBUG : Received response(xid=40): (b'somedata37', ZnodeStat(czxid=71, mzxid=71, ctime=1777502848835, mtime=1777502848835, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=71)) (connection.py:410, _read_response) 2026-04-29 22:47:48 [ 539 ] DEBUG : Sending request(xid=40): GetData(path='/test_snapshot_multinode_recover37', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:48 [ 539 ] DEBUG : Received response(xid=40): (b'somedata37', ZnodeStat(czxid=71, mzxid=71, ctime=1777502848835, mtime=1777502848835, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=71)) (connection.py:410, _read_response) 2026-04-29 22:47:48 [ 539 ] DEBUG : Sending request(xid=41): GetData(path='/test_snapshot_multinode_recover38', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:48 [ 539 ] DEBUG : Received response(xid=41): (b'somedata38', ZnodeStat(czxid=72, mzxid=72, ctime=1777502848855, mtime=1777502848855, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=72)) (connection.py:410, _read_response) 2026-04-29 22:47:48 [ 539 ] DEBUG : Sending request(xid=41): GetData(path='/test_snapshot_multinode_recover38', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:48 [ 539 ] DEBUG : Received response(xid=41): (b'somedata38', ZnodeStat(czxid=72, mzxid=72, ctime=1777502848855, mtime=1777502848855, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=72)) (connection.py:410, _read_response) 2026-04-29 22:47:48 [ 539 ] DEBUG : Sending request(xid=41): GetData(path='/test_snapshot_multinode_recover38', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:48 [ 539 ] DEBUG : Received response(xid=41): (b'somedata38', ZnodeStat(czxid=72, mzxid=72, ctime=1777502848855, mtime=1777502848855, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=72)) (connection.py:410, _read_response) 2026-04-29 22:47:48 [ 539 ] DEBUG : Sending request(xid=42): GetData(path='/test_snapshot_multinode_recover39', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:48 [ 539 ] DEBUG : Received response(xid=42): (b'somedata39', ZnodeStat(czxid=73, mzxid=73, ctime=1777502848873, mtime=1777502848873, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=73)) (connection.py:410, _read_response) 2026-04-29 22:47:48 [ 539 ] DEBUG : Sending request(xid=42): GetData(path='/test_snapshot_multinode_recover39', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:48 [ 539 ] DEBUG : Received response(xid=42): (b'somedata39', ZnodeStat(czxid=73, mzxid=73, ctime=1777502848873, mtime=1777502848873, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=73)) (connection.py:410, _read_response) 2026-04-29 22:47:48 [ 539 ] DEBUG : Sending request(xid=42): GetData(path='/test_snapshot_multinode_recover39', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:48 [ 539 ] DEBUG : Received response(xid=42): (b'somedata39', ZnodeStat(czxid=73, mzxid=73, ctime=1777502848873, mtime=1777502848873, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=73)) (connection.py:410, _read_response) 2026-04-29 22:47:48 [ 539 ] DEBUG : Sending request(xid=43): Exists(path='/test_snapshot_multinode_recover40', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:48 [ 539 ] DEBUG : Sending request(xid=43): Exists(path='/test_snapshot_multinode_recover40', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:48 [ 539 ] DEBUG : Sending request(xid=43): Exists(path='/test_snapshot_multinode_recover40', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:48 [ 539 ] DEBUG : Sending request(xid=44): GetData(path='/test_snapshot_multinode_recover41', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:48 [ 539 ] DEBUG : Received response(xid=44): (b'somedata41', ZnodeStat(czxid=75, mzxid=75, ctime=1777502848921, mtime=1777502848921, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=75)) (connection.py:410, _read_response) 2026-04-29 22:47:48 [ 539 ] DEBUG : Sending request(xid=44): GetData(path='/test_snapshot_multinode_recover41', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:48 [ 539 ] DEBUG : Received response(xid=44): (b'somedata41', ZnodeStat(czxid=75, mzxid=75, ctime=1777502848921, mtime=1777502848921, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=75)) (connection.py:410, _read_response) 2026-04-29 22:47:48 [ 539 ] DEBUG : Sending request(xid=44): GetData(path='/test_snapshot_multinode_recover41', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:48 [ 539 ] DEBUG : Received response(xid=44): (b'somedata41', ZnodeStat(czxid=75, mzxid=75, ctime=1777502848921, mtime=1777502848921, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=75)) (connection.py:410, _read_response) 2026-04-29 22:47:48 [ 539 ] DEBUG : Sending request(xid=45): GetData(path='/test_snapshot_multinode_recover42', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:48 [ 539 ] DEBUG : Received response(xid=45): (b'somedata42', ZnodeStat(czxid=76, mzxid=76, ctime=1777502848949, mtime=1777502848949, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=76)) (connection.py:410, _read_response) 2026-04-29 22:47:48 [ 539 ] DEBUG : Sending request(xid=45): GetData(path='/test_snapshot_multinode_recover42', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:48 [ 539 ] DEBUG : Received response(xid=45): (b'somedata42', ZnodeStat(czxid=76, mzxid=76, ctime=1777502848949, mtime=1777502848949, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=76)) (connection.py:410, _read_response) 2026-04-29 22:47:48 [ 539 ] DEBUG : Sending request(xid=45): GetData(path='/test_snapshot_multinode_recover42', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:48 [ 539 ] DEBUG : Received response(xid=45): (b'somedata42', ZnodeStat(czxid=76, mzxid=76, ctime=1777502848949, mtime=1777502848949, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=76)) (connection.py:410, _read_response) 2026-04-29 22:47:48 [ 539 ] DEBUG : Sending request(xid=46): GetData(path='/test_snapshot_multinode_recover43', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:48 [ 539 ] DEBUG : Received response(xid=46): (b'somedata43', ZnodeStat(czxid=77, mzxid=77, ctime=1777502848989, mtime=1777502848989, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=77)) (connection.py:410, _read_response) 2026-04-29 22:47:48 [ 539 ] DEBUG : Sending request(xid=46): GetData(path='/test_snapshot_multinode_recover43', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:48 [ 539 ] DEBUG : Received response(xid=46): (b'somedata43', ZnodeStat(czxid=77, mzxid=77, ctime=1777502848989, mtime=1777502848989, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=77)) (connection.py:410, _read_response) 2026-04-29 22:47:48 [ 539 ] DEBUG : Sending request(xid=46): GetData(path='/test_snapshot_multinode_recover43', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:49 [ 539 ] DEBUG : Received response(xid=46): (b'somedata43', ZnodeStat(czxid=77, mzxid=77, ctime=1777502848989, mtime=1777502848989, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=77)) (connection.py:410, _read_response) 2026-04-29 22:47:49 [ 539 ] DEBUG : Sending request(xid=47): GetData(path='/test_snapshot_multinode_recover44', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:49 [ 539 ] DEBUG : Received response(xid=47): (b'somedata44', ZnodeStat(czxid=78, mzxid=78, ctime=1777502849022, mtime=1777502849022, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=78)) (connection.py:410, _read_response) 2026-04-29 22:47:49 [ 539 ] DEBUG : Sending request(xid=47): GetData(path='/test_snapshot_multinode_recover44', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:49 [ 539 ] DEBUG : Received response(xid=47): (b'somedata44', ZnodeStat(czxid=78, mzxid=78, ctime=1777502849022, mtime=1777502849022, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=78)) (connection.py:410, _read_response) 2026-04-29 22:47:49 [ 539 ] DEBUG : Sending request(xid=47): GetData(path='/test_snapshot_multinode_recover44', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:49 [ 539 ] DEBUG : Received response(xid=47): (b'somedata44', ZnodeStat(czxid=78, mzxid=78, ctime=1777502849022, mtime=1777502849022, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=78)) (connection.py:410, _read_response) 2026-04-29 22:47:49 [ 539 ] DEBUG : Sending request(xid=48): GetData(path='/test_snapshot_multinode_recover45', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:49 [ 539 ] DEBUG : Received response(xid=48): (b'somedata45', ZnodeStat(czxid=79, mzxid=79, ctime=1777502849061, mtime=1777502849061, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=79)) (connection.py:410, _read_response) 2026-04-29 22:47:49 [ 539 ] DEBUG : Sending request(xid=48): GetData(path='/test_snapshot_multinode_recover45', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:49 [ 539 ] DEBUG : Received response(xid=48): (b'somedata45', ZnodeStat(czxid=79, mzxid=79, ctime=1777502849061, mtime=1777502849061, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=79)) (connection.py:410, _read_response) 2026-04-29 22:47:49 [ 539 ] DEBUG : Sending request(xid=48): GetData(path='/test_snapshot_multinode_recover45', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:49 [ 539 ] DEBUG : Received response(xid=48): (b'somedata45', ZnodeStat(czxid=79, mzxid=79, ctime=1777502849061, mtime=1777502849061, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=79)) (connection.py:410, _read_response) 2026-04-29 22:47:49 [ 539 ] DEBUG : Sending request(xid=49): GetData(path='/test_snapshot_multinode_recover46', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:49 [ 539 ] DEBUG : Received response(xid=49): (b'somedata46', ZnodeStat(czxid=80, mzxid=80, ctime=1777502849074, mtime=1777502849074, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=80)) (connection.py:410, _read_response) 2026-04-29 22:47:49 [ 539 ] DEBUG : Sending request(xid=49): GetData(path='/test_snapshot_multinode_recover46', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:49 [ 539 ] DEBUG : Received response(xid=49): (b'somedata46', ZnodeStat(czxid=80, mzxid=80, ctime=1777502849074, mtime=1777502849074, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=80)) (connection.py:410, _read_response) 2026-04-29 22:47:49 [ 539 ] DEBUG : Sending request(xid=49): GetData(path='/test_snapshot_multinode_recover46', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:49 [ 539 ] DEBUG : Received response(xid=49): (b'somedata46', ZnodeStat(czxid=80, mzxid=80, ctime=1777502849074, mtime=1777502849074, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=80)) (connection.py:410, _read_response) 2026-04-29 22:47:49 [ 539 ] DEBUG : Sending request(xid=50): GetData(path='/test_snapshot_multinode_recover47', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:49 [ 539 ] DEBUG : Received response(xid=50): (b'somedata47', ZnodeStat(czxid=81, mzxid=81, ctime=1777502849093, mtime=1777502849093, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=81)) (connection.py:410, _read_response) 2026-04-29 22:47:49 [ 539 ] DEBUG : Sending request(xid=50): GetData(path='/test_snapshot_multinode_recover47', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:49 [ 539 ] DEBUG : Received response(xid=50): (b'somedata47', ZnodeStat(czxid=81, mzxid=81, ctime=1777502849093, mtime=1777502849093, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=81)) (connection.py:410, _read_response) 2026-04-29 22:47:49 [ 539 ] DEBUG : Sending request(xid=50): GetData(path='/test_snapshot_multinode_recover47', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:49 [ 539 ] DEBUG : Received response(xid=50): (b'somedata47', ZnodeStat(czxid=81, mzxid=81, ctime=1777502849093, mtime=1777502849093, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=81)) (connection.py:410, _read_response) 2026-04-29 22:47:49 [ 539 ] DEBUG : Sending request(xid=51): GetData(path='/test_snapshot_multinode_recover48', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:49 [ 539 ] DEBUG : Received response(xid=51): (b'somedata48', ZnodeStat(czxid=82, mzxid=82, ctime=1777502849120, mtime=1777502849120, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=82)) (connection.py:410, _read_response) 2026-04-29 22:47:49 [ 539 ] DEBUG : Sending request(xid=51): GetData(path='/test_snapshot_multinode_recover48', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:49 [ 539 ] DEBUG : Received response(xid=51): (b'somedata48', ZnodeStat(czxid=82, mzxid=82, ctime=1777502849120, mtime=1777502849120, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=82)) (connection.py:410, _read_response) 2026-04-29 22:47:49 [ 539 ] DEBUG : Sending request(xid=51): GetData(path='/test_snapshot_multinode_recover48', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:49 [ 539 ] DEBUG : Received response(xid=51): (b'somedata48', ZnodeStat(czxid=82, mzxid=82, ctime=1777502849120, mtime=1777502849120, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=82)) (connection.py:410, _read_response) 2026-04-29 22:47:49 [ 539 ] DEBUG : Sending request(xid=52): GetData(path='/test_snapshot_multinode_recover49', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:49 [ 539 ] DEBUG : Received response(xid=52): (b'somedata49', ZnodeStat(czxid=83, mzxid=83, ctime=1777502849141, mtime=1777502849141, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=83)) (connection.py:410, _read_response) 2026-04-29 22:47:49 [ 539 ] DEBUG : Sending request(xid=52): GetData(path='/test_snapshot_multinode_recover49', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:49 [ 539 ] DEBUG : Received response(xid=52): (b'somedata49', ZnodeStat(czxid=83, mzxid=83, ctime=1777502849141, mtime=1777502849141, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=83)) (connection.py:410, _read_response) 2026-04-29 22:47:49 [ 539 ] DEBUG : Sending request(xid=52): GetData(path='/test_snapshot_multinode_recover49', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:49 [ 539 ] DEBUG : Received response(xid=52): (b'somedata49', ZnodeStat(czxid=83, mzxid=83, ctime=1777502849141, mtime=1777502849141, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=83)) (connection.py:410, _read_response) 2026-04-29 22:47:49 [ 539 ] DEBUG : Sending request(xid=53): Exists(path='/test_snapshot_multinode_recover50', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:49 [ 539 ] DEBUG : Sending request(xid=53): Exists(path='/test_snapshot_multinode_recover50', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:49 [ 539 ] DEBUG : Sending request(xid=53): Exists(path='/test_snapshot_multinode_recover50', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:49 [ 539 ] DEBUG : Sending request(xid=54): GetData(path='/test_snapshot_multinode_recover51', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:49 [ 539 ] DEBUG : Received response(xid=54): (b'somedata51', ZnodeStat(czxid=85, mzxid=85, ctime=1777502849172, mtime=1777502849172, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=85)) (connection.py:410, _read_response) 2026-04-29 22:47:49 [ 539 ] DEBUG : Sending request(xid=54): GetData(path='/test_snapshot_multinode_recover51', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:49 [ 539 ] DEBUG : Received response(xid=54): (b'somedata51', ZnodeStat(czxid=85, mzxid=85, ctime=1777502849172, mtime=1777502849172, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=85)) (connection.py:410, _read_response) 2026-04-29 22:47:49 [ 539 ] DEBUG : Sending request(xid=54): GetData(path='/test_snapshot_multinode_recover51', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:49 [ 539 ] DEBUG : Received response(xid=54): (b'somedata51', ZnodeStat(czxid=85, mzxid=85, ctime=1777502849172, mtime=1777502849172, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=85)) (connection.py:410, _read_response) 2026-04-29 22:47:49 [ 539 ] DEBUG : Sending request(xid=55): GetData(path='/test_snapshot_multinode_recover52', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:49 [ 539 ] DEBUG : Received response(xid=55): (b'somedata52', ZnodeStat(czxid=86, mzxid=86, ctime=1777502849193, mtime=1777502849193, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=86)) (connection.py:410, _read_response) 2026-04-29 22:47:49 [ 539 ] DEBUG : Sending request(xid=55): GetData(path='/test_snapshot_multinode_recover52', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:49 [ 539 ] DEBUG : Received response(xid=55): (b'somedata52', ZnodeStat(czxid=86, mzxid=86, ctime=1777502849193, mtime=1777502849193, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=86)) (connection.py:410, _read_response) 2026-04-29 22:47:49 [ 539 ] DEBUG : Sending request(xid=55): GetData(path='/test_snapshot_multinode_recover52', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:49 [ 539 ] DEBUG : Received response(xid=55): (b'somedata52', ZnodeStat(czxid=86, mzxid=86, ctime=1777502849193, mtime=1777502849193, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=86)) (connection.py:410, _read_response) 2026-04-29 22:47:49 [ 539 ] DEBUG : Sending request(xid=56): GetData(path='/test_snapshot_multinode_recover53', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:49 [ 539 ] DEBUG : Received response(xid=56): (b'somedata53', ZnodeStat(czxid=87, mzxid=87, ctime=1777502849223, mtime=1777502849223, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=87)) (connection.py:410, _read_response) 2026-04-29 22:47:49 [ 539 ] DEBUG : Sending request(xid=56): GetData(path='/test_snapshot_multinode_recover53', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:49 [ 539 ] DEBUG : Received response(xid=56): (b'somedata53', ZnodeStat(czxid=87, mzxid=87, ctime=1777502849223, mtime=1777502849223, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=87)) (connection.py:410, _read_response) 2026-04-29 22:47:49 [ 539 ] DEBUG : Sending request(xid=56): GetData(path='/test_snapshot_multinode_recover53', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:49 [ 539 ] DEBUG : Received response(xid=56): (b'somedata53', ZnodeStat(czxid=87, mzxid=87, ctime=1777502849223, mtime=1777502849223, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=87)) (connection.py:410, _read_response) 2026-04-29 22:47:49 [ 539 ] DEBUG : Sending request(xid=57): GetData(path='/test_snapshot_multinode_recover54', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:49 [ 539 ] DEBUG : Received response(xid=57): (b'somedata54', ZnodeStat(czxid=88, mzxid=88, ctime=1777502849238, mtime=1777502849238, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=88)) (connection.py:410, _read_response) 2026-04-29 22:47:49 [ 539 ] DEBUG : Sending request(xid=57): GetData(path='/test_snapshot_multinode_recover54', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:49 [ 539 ] DEBUG : Received response(xid=57): (b'somedata54', ZnodeStat(czxid=88, mzxid=88, ctime=1777502849238, mtime=1777502849238, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=88)) (connection.py:410, _read_response) 2026-04-29 22:47:49 [ 539 ] DEBUG : Sending request(xid=57): GetData(path='/test_snapshot_multinode_recover54', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:49 [ 539 ] DEBUG : Received response(xid=57): (b'somedata54', ZnodeStat(czxid=88, mzxid=88, ctime=1777502849238, mtime=1777502849238, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=88)) (connection.py:410, _read_response) 2026-04-29 22:47:49 [ 539 ] DEBUG : Sending request(xid=58): GetData(path='/test_snapshot_multinode_recover55', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:49 [ 539 ] DEBUG : Received response(xid=58): (b'somedata55', ZnodeStat(czxid=89, mzxid=89, ctime=1777502849267, mtime=1777502849267, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=89)) (connection.py:410, _read_response) 2026-04-29 22:47:49 [ 539 ] DEBUG : Sending request(xid=58): GetData(path='/test_snapshot_multinode_recover55', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:49 [ 539 ] DEBUG : Received response(xid=58): (b'somedata55', ZnodeStat(czxid=89, mzxid=89, ctime=1777502849267, mtime=1777502849267, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=89)) (connection.py:410, _read_response) 2026-04-29 22:47:49 [ 539 ] DEBUG : Sending request(xid=58): GetData(path='/test_snapshot_multinode_recover55', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:49 [ 539 ] DEBUG : Received response(xid=58): (b'somedata55', ZnodeStat(czxid=89, mzxid=89, ctime=1777502849267, mtime=1777502849267, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=89)) (connection.py:410, _read_response) 2026-04-29 22:47:49 [ 539 ] DEBUG : Sending request(xid=59): GetData(path='/test_snapshot_multinode_recover56', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:49 [ 539 ] DEBUG : Received response(xid=59): (b'somedata56', ZnodeStat(czxid=90, mzxid=90, ctime=1777502849298, mtime=1777502849298, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=90)) (connection.py:410, _read_response) 2026-04-29 22:47:49 [ 539 ] DEBUG : Sending request(xid=59): GetData(path='/test_snapshot_multinode_recover56', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:49 [ 539 ] DEBUG : Received response(xid=59): (b'somedata56', ZnodeStat(czxid=90, mzxid=90, ctime=1777502849298, mtime=1777502849298, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=90)) (connection.py:410, _read_response) 2026-04-29 22:47:49 [ 539 ] DEBUG : Sending request(xid=59): GetData(path='/test_snapshot_multinode_recover56', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:49 [ 539 ] DEBUG : Received response(xid=59): (b'somedata56', ZnodeStat(czxid=90, mzxid=90, ctime=1777502849298, mtime=1777502849298, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=90)) (connection.py:410, _read_response) 2026-04-29 22:47:49 [ 539 ] DEBUG : Sending request(xid=60): GetData(path='/test_snapshot_multinode_recover57', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:49 [ 539 ] DEBUG : Received response(xid=60): (b'somedata57', ZnodeStat(czxid=91, mzxid=91, ctime=1777502849331, mtime=1777502849331, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=91)) (connection.py:410, _read_response) 2026-04-29 22:47:49 [ 539 ] DEBUG : Sending request(xid=60): GetData(path='/test_snapshot_multinode_recover57', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:49 [ 539 ] DEBUG : Received response(xid=60): (b'somedata57', ZnodeStat(czxid=91, mzxid=91, ctime=1777502849331, mtime=1777502849331, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=91)) (connection.py:410, _read_response) 2026-04-29 22:47:49 [ 539 ] DEBUG : Sending request(xid=60): GetData(path='/test_snapshot_multinode_recover57', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:49 [ 539 ] DEBUG : Received response(xid=60): (b'somedata57', ZnodeStat(czxid=91, mzxid=91, ctime=1777502849331, mtime=1777502849331, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=91)) (connection.py:410, _read_response) 2026-04-29 22:47:49 [ 539 ] DEBUG : Sending request(xid=61): GetData(path='/test_snapshot_multinode_recover58', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:49 [ 539 ] DEBUG : Received response(xid=61): (b'somedata58', ZnodeStat(czxid=92, mzxid=92, ctime=1777502849348, mtime=1777502849348, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=92)) (connection.py:410, _read_response) 2026-04-29 22:47:49 [ 539 ] DEBUG : Sending request(xid=61): GetData(path='/test_snapshot_multinode_recover58', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:49 [ 539 ] DEBUG : Received response(xid=61): (b'somedata58', ZnodeStat(czxid=92, mzxid=92, ctime=1777502849348, mtime=1777502849348, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=92)) (connection.py:410, _read_response) 2026-04-29 22:47:49 [ 539 ] DEBUG : Sending request(xid=61): GetData(path='/test_snapshot_multinode_recover58', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:49 [ 539 ] DEBUG : Received response(xid=61): (b'somedata58', ZnodeStat(czxid=92, mzxid=92, ctime=1777502849348, mtime=1777502849348, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=92)) (connection.py:410, _read_response) 2026-04-29 22:47:49 [ 539 ] DEBUG : Sending request(xid=62): GetData(path='/test_snapshot_multinode_recover59', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:49 [ 539 ] DEBUG : Received response(xid=62): (b'somedata59', ZnodeStat(czxid=93, mzxid=93, ctime=1777502849372, mtime=1777502849372, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=93)) (connection.py:410, _read_response) 2026-04-29 22:47:49 [ 539 ] DEBUG : Sending request(xid=62): GetData(path='/test_snapshot_multinode_recover59', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:49 [ 539 ] DEBUG : Received response(xid=62): (b'somedata59', ZnodeStat(czxid=93, mzxid=93, ctime=1777502849372, mtime=1777502849372, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=93)) (connection.py:410, _read_response) 2026-04-29 22:47:49 [ 539 ] DEBUG : Sending request(xid=62): GetData(path='/test_snapshot_multinode_recover59', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:49 [ 539 ] DEBUG : Received response(xid=62): (b'somedata59', ZnodeStat(czxid=93, mzxid=93, ctime=1777502849372, mtime=1777502849372, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=93)) (connection.py:410, _read_response) 2026-04-29 22:47:49 [ 539 ] DEBUG : Sending request(xid=63): Exists(path='/test_snapshot_multinode_recover60', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:49 [ 539 ] DEBUG : Sending request(xid=63): Exists(path='/test_snapshot_multinode_recover60', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:49 [ 539 ] DEBUG : Sending request(xid=63): Exists(path='/test_snapshot_multinode_recover60', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:49 [ 539 ] DEBUG : Sending request(xid=64): GetData(path='/test_snapshot_multinode_recover61', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:49 [ 539 ] DEBUG : Received response(xid=64): (b'somedata61', ZnodeStat(czxid=95, mzxid=95, ctime=1777502849426, mtime=1777502849426, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=95)) (connection.py:410, _read_response) 2026-04-29 22:47:49 [ 539 ] DEBUG : Sending request(xid=64): GetData(path='/test_snapshot_multinode_recover61', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:49 [ 539 ] DEBUG : Received response(xid=64): (b'somedata61', ZnodeStat(czxid=95, mzxid=95, ctime=1777502849426, mtime=1777502849426, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=95)) (connection.py:410, _read_response) 2026-04-29 22:47:49 [ 539 ] DEBUG : Sending request(xid=64): GetData(path='/test_snapshot_multinode_recover61', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:49 [ 539 ] DEBUG : Received response(xid=64): (b'somedata61', ZnodeStat(czxid=95, mzxid=95, ctime=1777502849426, mtime=1777502849426, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=95)) (connection.py:410, _read_response) 2026-04-29 22:47:49 [ 539 ] DEBUG : Sending request(xid=65): GetData(path='/test_snapshot_multinode_recover62', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:49 [ 539 ] DEBUG : Received response(xid=65): (b'somedata62', ZnodeStat(czxid=96, mzxid=96, ctime=1777502849456, mtime=1777502849456, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=96)) (connection.py:410, _read_response) 2026-04-29 22:47:49 [ 539 ] DEBUG : Sending request(xid=65): GetData(path='/test_snapshot_multinode_recover62', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:49 [ 539 ] DEBUG : Received response(xid=65): (b'somedata62', ZnodeStat(czxid=96, mzxid=96, ctime=1777502849456, mtime=1777502849456, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=96)) (connection.py:410, _read_response) 2026-04-29 22:47:49 [ 539 ] DEBUG : Sending request(xid=65): GetData(path='/test_snapshot_multinode_recover62', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:49 [ 539 ] DEBUG : Received response(xid=65): (b'somedata62', ZnodeStat(czxid=96, mzxid=96, ctime=1777502849456, mtime=1777502849456, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=96)) (connection.py:410, _read_response) 2026-04-29 22:47:49 [ 539 ] DEBUG : Sending request(xid=66): GetData(path='/test_snapshot_multinode_recover63', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:49 [ 539 ] DEBUG : Received response(xid=66): (b'somedata63', ZnodeStat(czxid=97, mzxid=97, ctime=1777502849478, mtime=1777502849478, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=97)) (connection.py:410, _read_response) 2026-04-29 22:47:49 [ 539 ] DEBUG : Sending request(xid=66): GetData(path='/test_snapshot_multinode_recover63', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:49 [ 539 ] DEBUG : Received response(xid=66): (b'somedata63', ZnodeStat(czxid=97, mzxid=97, ctime=1777502849478, mtime=1777502849478, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=97)) (connection.py:410, _read_response) 2026-04-29 22:47:49 [ 539 ] DEBUG : Sending request(xid=66): GetData(path='/test_snapshot_multinode_recover63', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:49 [ 539 ] DEBUG : Received response(xid=66): (b'somedata63', ZnodeStat(czxid=97, mzxid=97, ctime=1777502849478, mtime=1777502849478, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=97)) (connection.py:410, _read_response) 2026-04-29 22:47:49 [ 539 ] DEBUG : Sending request(xid=67): GetData(path='/test_snapshot_multinode_recover64', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:49 [ 539 ] DEBUG : Received response(xid=67): (b'somedata64', ZnodeStat(czxid=98, mzxid=98, ctime=1777502849509, mtime=1777502849509, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=98)) (connection.py:410, _read_response) 2026-04-29 22:47:50 [ 539 ] DEBUG : Sending request(xid=67): GetData(path='/test_snapshot_multinode_recover64', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:50 [ 539 ] DEBUG : Received response(xid=67): (b'somedata64', ZnodeStat(czxid=98, mzxid=98, ctime=1777502849509, mtime=1777502849509, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=98)) (connection.py:410, _read_response) 2026-04-29 22:47:50 [ 539 ] DEBUG : Sending request(xid=67): GetData(path='/test_snapshot_multinode_recover64', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:50 [ 539 ] DEBUG : Received response(xid=67): (b'somedata64', ZnodeStat(czxid=98, mzxid=98, ctime=1777502849509, mtime=1777502849509, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=98)) (connection.py:410, _read_response) 2026-04-29 22:47:50 [ 539 ] DEBUG : Sending request(xid=68): GetData(path='/test_snapshot_multinode_recover65', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:50 [ 539 ] DEBUG : Received response(xid=68): (b'somedata65', ZnodeStat(czxid=99, mzxid=99, ctime=1777502849532, mtime=1777502849532, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=99)) (connection.py:410, _read_response) 2026-04-29 22:47:50 [ 539 ] DEBUG : Sending request(xid=68): GetData(path='/test_snapshot_multinode_recover65', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:50 [ 539 ] DEBUG : Received response(xid=68): (b'somedata65', ZnodeStat(czxid=99, mzxid=99, ctime=1777502849532, mtime=1777502849532, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=99)) (connection.py:410, _read_response) 2026-04-29 22:47:50 [ 539 ] DEBUG : Sending request(xid=68): GetData(path='/test_snapshot_multinode_recover65', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:50 [ 539 ] DEBUG : Received response(xid=68): (b'somedata65', ZnodeStat(czxid=99, mzxid=99, ctime=1777502849532, mtime=1777502849532, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=99)) (connection.py:410, _read_response) 2026-04-29 22:47:50 [ 539 ] DEBUG : Sending request(xid=69): GetData(path='/test_snapshot_multinode_recover66', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:50 [ 539 ] DEBUG : Received response(xid=69): (b'somedata66', ZnodeStat(czxid=101, mzxid=101, ctime=1777502849562, mtime=1777502849562, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=101)) (connection.py:410, _read_response) 2026-04-29 22:47:50 [ 539 ] DEBUG : Sending request(xid=69): GetData(path='/test_snapshot_multinode_recover66', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:50 [ 539 ] DEBUG : Received response(xid=69): (b'somedata66', ZnodeStat(czxid=101, mzxid=101, ctime=1777502849562, mtime=1777502849562, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=101)) (connection.py:410, _read_response) 2026-04-29 22:47:50 [ 539 ] DEBUG : Sending request(xid=69): GetData(path='/test_snapshot_multinode_recover66', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:50 [ 539 ] DEBUG : Received response(xid=69): (b'somedata66', ZnodeStat(czxid=101, mzxid=101, ctime=1777502849562, mtime=1777502849562, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=101)) (connection.py:410, _read_response) 2026-04-29 22:47:50 [ 539 ] DEBUG : Sending request(xid=70): GetData(path='/test_snapshot_multinode_recover67', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:50 [ 539 ] DEBUG : Received response(xid=70): (b'somedata67', ZnodeStat(czxid=102, mzxid=102, ctime=1777502849607, mtime=1777502849607, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=102)) (connection.py:410, _read_response) 2026-04-29 22:47:50 [ 539 ] DEBUG : Sending request(xid=70): GetData(path='/test_snapshot_multinode_recover67', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:50 [ 539 ] DEBUG : Received response(xid=70): (b'somedata67', ZnodeStat(czxid=102, mzxid=102, ctime=1777502849607, mtime=1777502849607, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=102)) (connection.py:410, _read_response) 2026-04-29 22:47:50 [ 539 ] DEBUG : Sending request(xid=70): GetData(path='/test_snapshot_multinode_recover67', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:50 [ 539 ] DEBUG : Received response(xid=70): (b'somedata67', ZnodeStat(czxid=102, mzxid=102, ctime=1777502849607, mtime=1777502849607, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=102)) (connection.py:410, _read_response) 2026-04-29 22:47:50 [ 539 ] DEBUG : Sending request(xid=71): GetData(path='/test_snapshot_multinode_recover68', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:50 [ 539 ] DEBUG : Received response(xid=71): (b'somedata68', ZnodeStat(czxid=104, mzxid=104, ctime=1777502849649, mtime=1777502849649, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=104)) (connection.py:410, _read_response) 2026-04-29 22:47:50 [ 539 ] DEBUG : Sending request(xid=71): GetData(path='/test_snapshot_multinode_recover68', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:50 [ 539 ] DEBUG : Received response(xid=71): (b'somedata68', ZnodeStat(czxid=104, mzxid=104, ctime=1777502849649, mtime=1777502849649, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=104)) (connection.py:410, _read_response) 2026-04-29 22:47:50 [ 539 ] DEBUG : Sending request(xid=71): GetData(path='/test_snapshot_multinode_recover68', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:50 [ 539 ] DEBUG : Received response(xid=71): (b'somedata68', ZnodeStat(czxid=104, mzxid=104, ctime=1777502849649, mtime=1777502849649, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=104)) (connection.py:410, _read_response) 2026-04-29 22:47:50 [ 539 ] DEBUG : Sending request(xid=72): GetData(path='/test_snapshot_multinode_recover69', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:50 [ 539 ] DEBUG : Received response(xid=72): (b'somedata69', ZnodeStat(czxid=105, mzxid=105, ctime=1777502849675, mtime=1777502849675, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=105)) (connection.py:410, _read_response) 2026-04-29 22:47:50 [ 539 ] DEBUG : Sending request(xid=72): GetData(path='/test_snapshot_multinode_recover69', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:50 [ 539 ] DEBUG : Received response(xid=72): (b'somedata69', ZnodeStat(czxid=105, mzxid=105, ctime=1777502849675, mtime=1777502849675, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=105)) (connection.py:410, _read_response) 2026-04-29 22:47:50 [ 539 ] DEBUG : Sending request(xid=72): GetData(path='/test_snapshot_multinode_recover69', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:50 [ 539 ] DEBUG : Received response(xid=72): (b'somedata69', ZnodeStat(czxid=105, mzxid=105, ctime=1777502849675, mtime=1777502849675, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=105)) (connection.py:410, _read_response) 2026-04-29 22:47:50 [ 539 ] DEBUG : Sending request(xid=73): Exists(path='/test_snapshot_multinode_recover70', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:50 [ 539 ] DEBUG : Sending request(xid=73): Exists(path='/test_snapshot_multinode_recover70', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:50 [ 539 ] DEBUG : Sending request(xid=73): Exists(path='/test_snapshot_multinode_recover70', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:50 [ 539 ] DEBUG : Sending request(xid=74): GetData(path='/test_snapshot_multinode_recover71', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:50 [ 539 ] DEBUG : Received response(xid=74): (b'somedata71', ZnodeStat(czxid=107, mzxid=107, ctime=1777502849725, mtime=1777502849725, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=107)) (connection.py:410, _read_response) 2026-04-29 22:47:50 [ 539 ] DEBUG : Sending request(xid=74): GetData(path='/test_snapshot_multinode_recover71', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:50 [ 539 ] DEBUG : Received response(xid=74): (b'somedata71', ZnodeStat(czxid=107, mzxid=107, ctime=1777502849725, mtime=1777502849725, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=107)) (connection.py:410, _read_response) 2026-04-29 22:47:50 [ 539 ] DEBUG : Sending request(xid=74): GetData(path='/test_snapshot_multinode_recover71', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:50 [ 539 ] DEBUG : Received response(xid=74): (b'somedata71', ZnodeStat(czxid=107, mzxid=107, ctime=1777502849725, mtime=1777502849725, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=107)) (connection.py:410, _read_response) 2026-04-29 22:47:50 [ 539 ] DEBUG : Sending request(xid=75): GetData(path='/test_snapshot_multinode_recover72', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:50 [ 539 ] DEBUG : Received response(xid=75): (b'somedata72', ZnodeStat(czxid=108, mzxid=108, ctime=1777502849739, mtime=1777502849739, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=108)) (connection.py:410, _read_response) 2026-04-29 22:47:50 [ 539 ] DEBUG : Sending request(xid=75): GetData(path='/test_snapshot_multinode_recover72', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:50 [ 539 ] DEBUG : Received response(xid=75): (b'somedata72', ZnodeStat(czxid=108, mzxid=108, ctime=1777502849739, mtime=1777502849739, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=108)) (connection.py:410, _read_response) 2026-04-29 22:47:50 [ 539 ] DEBUG : Sending request(xid=75): GetData(path='/test_snapshot_multinode_recover72', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:50 [ 539 ] DEBUG : Received response(xid=75): (b'somedata72', ZnodeStat(czxid=108, mzxid=108, ctime=1777502849739, mtime=1777502849739, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=108)) (connection.py:410, _read_response) 2026-04-29 22:47:50 [ 539 ] DEBUG : Sending request(xid=76): GetData(path='/test_snapshot_multinode_recover73', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:50 [ 539 ] DEBUG : Received response(xid=76): (b'somedata73', ZnodeStat(czxid=109, mzxid=109, ctime=1777502849774, mtime=1777502849774, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=109)) (connection.py:410, _read_response) 2026-04-29 22:47:50 [ 539 ] DEBUG : Sending request(xid=76): GetData(path='/test_snapshot_multinode_recover73', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:50 [ 539 ] DEBUG : Received response(xid=76): (b'somedata73', ZnodeStat(czxid=109, mzxid=109, ctime=1777502849774, mtime=1777502849774, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=109)) (connection.py:410, _read_response) 2026-04-29 22:47:50 [ 539 ] DEBUG : Sending request(xid=76): GetData(path='/test_snapshot_multinode_recover73', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:50 [ 539 ] DEBUG : Received response(xid=76): (b'somedata73', ZnodeStat(czxid=109, mzxid=109, ctime=1777502849774, mtime=1777502849774, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=109)) (connection.py:410, _read_response) 2026-04-29 22:47:50 [ 539 ] DEBUG : Sending request(xid=77): GetData(path='/test_snapshot_multinode_recover74', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:50 [ 539 ] DEBUG : Received response(xid=77): (b'somedata74', ZnodeStat(czxid=110, mzxid=110, ctime=1777502849801, mtime=1777502849801, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=110)) (connection.py:410, _read_response) 2026-04-29 22:47:50 [ 539 ] DEBUG : Sending request(xid=77): GetData(path='/test_snapshot_multinode_recover74', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:50 [ 539 ] DEBUG : Received response(xid=77): (b'somedata74', ZnodeStat(czxid=110, mzxid=110, ctime=1777502849801, mtime=1777502849801, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=110)) (connection.py:410, _read_response) 2026-04-29 22:47:50 [ 539 ] DEBUG : Sending request(xid=77): GetData(path='/test_snapshot_multinode_recover74', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:50 [ 539 ] DEBUG : Received response(xid=77): (b'somedata74', ZnodeStat(czxid=110, mzxid=110, ctime=1777502849801, mtime=1777502849801, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=110)) (connection.py:410, _read_response) 2026-04-29 22:47:50 [ 539 ] DEBUG : Sending request(xid=78): GetData(path='/test_snapshot_multinode_recover75', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:50 [ 539 ] DEBUG : Received response(xid=78): (b'somedata75', ZnodeStat(czxid=111, mzxid=111, ctime=1777502849834, mtime=1777502849834, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=111)) (connection.py:410, _read_response) 2026-04-29 22:47:50 [ 539 ] DEBUG : Sending request(xid=78): GetData(path='/test_snapshot_multinode_recover75', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:50 [ 539 ] DEBUG : Received response(xid=78): (b'somedata75', ZnodeStat(czxid=111, mzxid=111, ctime=1777502849834, mtime=1777502849834, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=111)) (connection.py:410, _read_response) 2026-04-29 22:47:50 [ 539 ] DEBUG : Sending request(xid=78): GetData(path='/test_snapshot_multinode_recover75', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:50 [ 539 ] DEBUG : Received response(xid=78): (b'somedata75', ZnodeStat(czxid=111, mzxid=111, ctime=1777502849834, mtime=1777502849834, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=111)) (connection.py:410, _read_response) 2026-04-29 22:47:50 [ 539 ] DEBUG : Sending request(xid=79): GetData(path='/test_snapshot_multinode_recover76', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:50 [ 539 ] DEBUG : Received response(xid=79): (b'somedata76', ZnodeStat(czxid=112, mzxid=112, ctime=1777502849846, mtime=1777502849846, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=112)) (connection.py:410, _read_response) 2026-04-29 22:47:50 [ 539 ] DEBUG : Sending request(xid=79): GetData(path='/test_snapshot_multinode_recover76', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:50 [ 539 ] DEBUG : Received response(xid=79): (b'somedata76', ZnodeStat(czxid=112, mzxid=112, ctime=1777502849846, mtime=1777502849846, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=112)) (connection.py:410, _read_response) 2026-04-29 22:47:50 [ 539 ] DEBUG : Sending request(xid=79): GetData(path='/test_snapshot_multinode_recover76', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:50 [ 539 ] DEBUG : Received response(xid=79): (b'somedata76', ZnodeStat(czxid=112, mzxid=112, ctime=1777502849846, mtime=1777502849846, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=112)) (connection.py:410, _read_response) 2026-04-29 22:47:50 [ 539 ] DEBUG : Sending request(xid=80): GetData(path='/test_snapshot_multinode_recover77', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:50 [ 539 ] DEBUG : Received response(xid=80): (b'somedata77', ZnodeStat(czxid=113, mzxid=113, ctime=1777502849861, mtime=1777502849861, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=113)) (connection.py:410, _read_response) 2026-04-29 22:47:50 [ 539 ] DEBUG : Sending request(xid=80): GetData(path='/test_snapshot_multinode_recover77', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:50 [ 539 ] DEBUG : Received response(xid=80): (b'somedata77', ZnodeStat(czxid=113, mzxid=113, ctime=1777502849861, mtime=1777502849861, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=113)) (connection.py:410, _read_response) 2026-04-29 22:47:50 [ 539 ] DEBUG : Sending request(xid=80): GetData(path='/test_snapshot_multinode_recover77', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:50 [ 539 ] DEBUG : Received response(xid=80): (b'somedata77', ZnodeStat(czxid=113, mzxid=113, ctime=1777502849861, mtime=1777502849861, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=113)) (connection.py:410, _read_response) 2026-04-29 22:47:50 [ 539 ] DEBUG : Sending request(xid=81): GetData(path='/test_snapshot_multinode_recover78', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:50 [ 539 ] DEBUG : Received response(xid=81): (b'somedata78', ZnodeStat(czxid=114, mzxid=114, ctime=1777502849880, mtime=1777502849880, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=114)) (connection.py:410, _read_response) 2026-04-29 22:47:50 [ 539 ] DEBUG : Sending request(xid=81): GetData(path='/test_snapshot_multinode_recover78', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:50 [ 539 ] DEBUG : Received response(xid=81): (b'somedata78', ZnodeStat(czxid=114, mzxid=114, ctime=1777502849880, mtime=1777502849880, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=114)) (connection.py:410, _read_response) 2026-04-29 22:47:50 [ 539 ] DEBUG : Sending request(xid=81): GetData(path='/test_snapshot_multinode_recover78', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:50 [ 539 ] DEBUG : Received response(xid=81): (b'somedata78', ZnodeStat(czxid=114, mzxid=114, ctime=1777502849880, mtime=1777502849880, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=114)) (connection.py:410, _read_response) 2026-04-29 22:47:50 [ 539 ] DEBUG : Sending request(xid=82): GetData(path='/test_snapshot_multinode_recover79', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:50 [ 539 ] DEBUG : Received response(xid=82): (b'somedata79', ZnodeStat(czxid=115, mzxid=115, ctime=1777502849900, mtime=1777502849900, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=115)) (connection.py:410, _read_response) 2026-04-29 22:47:50 [ 539 ] DEBUG : Sending request(xid=82): GetData(path='/test_snapshot_multinode_recover79', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:50 [ 539 ] DEBUG : Received response(xid=82): (b'somedata79', ZnodeStat(czxid=115, mzxid=115, ctime=1777502849900, mtime=1777502849900, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=115)) (connection.py:410, _read_response) 2026-04-29 22:47:50 [ 539 ] DEBUG : Sending request(xid=82): GetData(path='/test_snapshot_multinode_recover79', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:50 [ 539 ] DEBUG : Received response(xid=82): (b'somedata79', ZnodeStat(czxid=115, mzxid=115, ctime=1777502849900, mtime=1777502849900, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=115)) (connection.py:410, _read_response) 2026-04-29 22:47:50 [ 539 ] DEBUG : Sending request(xid=83): Exists(path='/test_snapshot_multinode_recover80', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:50 [ 539 ] DEBUG : Sending request(xid=83): Exists(path='/test_snapshot_multinode_recover80', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:50 [ 539 ] DEBUG : Sending request(xid=83): Exists(path='/test_snapshot_multinode_recover80', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:50 [ 539 ] DEBUG : Sending request(xid=84): GetData(path='/test_snapshot_multinode_recover81', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:50 [ 539 ] DEBUG : Received response(xid=84): (b'somedata81', ZnodeStat(czxid=117, mzxid=117, ctime=1777502849939, mtime=1777502849939, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=117)) (connection.py:410, _read_response) 2026-04-29 22:47:50 [ 539 ] DEBUG : Sending request(xid=84): GetData(path='/test_snapshot_multinode_recover81', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:50 [ 539 ] DEBUG : Received response(xid=84): (b'somedata81', ZnodeStat(czxid=117, mzxid=117, ctime=1777502849939, mtime=1777502849939, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=117)) (connection.py:410, _read_response) 2026-04-29 22:47:50 [ 539 ] DEBUG : Sending request(xid=84): GetData(path='/test_snapshot_multinode_recover81', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:50 [ 539 ] DEBUG : Received response(xid=84): (b'somedata81', ZnodeStat(czxid=117, mzxid=117, ctime=1777502849939, mtime=1777502849939, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=117)) (connection.py:410, _read_response) 2026-04-29 22:47:50 [ 539 ] DEBUG : Sending request(xid=85): GetData(path='/test_snapshot_multinode_recover82', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:50 [ 539 ] DEBUG : Received response(xid=85): (b'somedata82', ZnodeStat(czxid=118, mzxid=118, ctime=1777502849966, mtime=1777502849966, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=118)) (connection.py:410, _read_response) 2026-04-29 22:47:50 [ 539 ] DEBUG : Sending request(xid=85): GetData(path='/test_snapshot_multinode_recover82', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:50 [ 539 ] DEBUG : Received response(xid=85): (b'somedata82', ZnodeStat(czxid=118, mzxid=118, ctime=1777502849966, mtime=1777502849966, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=118)) (connection.py:410, _read_response) 2026-04-29 22:47:50 [ 539 ] DEBUG : Sending request(xid=85): GetData(path='/test_snapshot_multinode_recover82', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:50 [ 539 ] DEBUG : Received response(xid=85): (b'somedata82', ZnodeStat(czxid=118, mzxid=118, ctime=1777502849966, mtime=1777502849966, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=118)) (connection.py:410, _read_response) 2026-04-29 22:47:50 [ 539 ] DEBUG : Sending request(xid=86): GetData(path='/test_snapshot_multinode_recover83', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:50 [ 539 ] DEBUG : Received response(xid=86): (b'somedata83', ZnodeStat(czxid=119, mzxid=119, ctime=1777502849987, mtime=1777502849987, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=119)) (connection.py:410, _read_response) 2026-04-29 22:47:50 [ 539 ] DEBUG : Sending request(xid=86): GetData(path='/test_snapshot_multinode_recover83', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:50 [ 539 ] DEBUG : Received response(xid=86): (b'somedata83', ZnodeStat(czxid=119, mzxid=119, ctime=1777502849987, mtime=1777502849987, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=119)) (connection.py:410, _read_response) 2026-04-29 22:47:50 [ 539 ] DEBUG : Sending request(xid=86): GetData(path='/test_snapshot_multinode_recover83', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:50 [ 539 ] DEBUG : Received response(xid=86): (b'somedata83', ZnodeStat(czxid=119, mzxid=119, ctime=1777502849987, mtime=1777502849987, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=119)) (connection.py:410, _read_response) 2026-04-29 22:47:50 [ 539 ] DEBUG : Sending request(xid=87): GetData(path='/test_snapshot_multinode_recover84', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:50 [ 539 ] DEBUG : Received response(xid=87): (b'somedata84', ZnodeStat(czxid=120, mzxid=120, ctime=1777502850009, mtime=1777502850009, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=120)) (connection.py:410, _read_response) 2026-04-29 22:47:50 [ 539 ] DEBUG : Sending request(xid=87): GetData(path='/test_snapshot_multinode_recover84', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:50 [ 539 ] DEBUG : Received response(xid=87): (b'somedata84', ZnodeStat(czxid=120, mzxid=120, ctime=1777502850009, mtime=1777502850009, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=120)) (connection.py:410, _read_response) 2026-04-29 22:47:50 [ 539 ] DEBUG : Sending request(xid=87): GetData(path='/test_snapshot_multinode_recover84', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:50 [ 539 ] DEBUG : Received response(xid=87): (b'somedata84', ZnodeStat(czxid=120, mzxid=120, ctime=1777502850009, mtime=1777502850009, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=120)) (connection.py:410, _read_response) 2026-04-29 22:47:50 [ 539 ] DEBUG : Sending request(xid=88): GetData(path='/test_snapshot_multinode_recover85', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:50 [ 539 ] DEBUG : Received response(xid=88): (b'somedata85', ZnodeStat(czxid=121, mzxid=121, ctime=1777502850041, mtime=1777502850041, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=121)) (connection.py:410, _read_response) 2026-04-29 22:47:50 [ 539 ] DEBUG : Sending request(xid=88): GetData(path='/test_snapshot_multinode_recover85', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:50 [ 539 ] DEBUG : Received response(xid=88): (b'somedata85', ZnodeStat(czxid=121, mzxid=121, ctime=1777502850041, mtime=1777502850041, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=121)) (connection.py:410, _read_response) 2026-04-29 22:47:50 [ 539 ] DEBUG : Sending request(xid=88): GetData(path='/test_snapshot_multinode_recover85', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:50 [ 539 ] DEBUG : Received response(xid=88): (b'somedata85', ZnodeStat(czxid=121, mzxid=121, ctime=1777502850041, mtime=1777502850041, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=121)) (connection.py:410, _read_response) 2026-04-29 22:47:50 [ 539 ] DEBUG : Sending request(xid=89): GetData(path='/test_snapshot_multinode_recover86', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:50 [ 539 ] DEBUG : Received response(xid=89): (b'somedata86', ZnodeStat(czxid=122, mzxid=122, ctime=1777502850077, mtime=1777502850077, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=122)) (connection.py:410, _read_response) 2026-04-29 22:47:50 [ 539 ] DEBUG : Sending request(xid=89): GetData(path='/test_snapshot_multinode_recover86', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:50 [ 539 ] DEBUG : Received response(xid=89): (b'somedata86', ZnodeStat(czxid=122, mzxid=122, ctime=1777502850077, mtime=1777502850077, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=122)) (connection.py:410, _read_response) 2026-04-29 22:47:50 [ 539 ] DEBUG : Sending request(xid=89): GetData(path='/test_snapshot_multinode_recover86', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:50 [ 539 ] DEBUG : Received response(xid=89): (b'somedata86', ZnodeStat(czxid=122, mzxid=122, ctime=1777502850077, mtime=1777502850077, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=122)) (connection.py:410, _read_response) 2026-04-29 22:47:50 [ 539 ] DEBUG : Sending request(xid=90): GetData(path='/test_snapshot_multinode_recover87', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:50 [ 539 ] DEBUG : Received response(xid=90): (b'somedata87', ZnodeStat(czxid=123, mzxid=123, ctime=1777502850099, mtime=1777502850099, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=123)) (connection.py:410, _read_response) 2026-04-29 22:47:50 [ 539 ] DEBUG : Sending request(xid=90): GetData(path='/test_snapshot_multinode_recover87', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:50 [ 539 ] DEBUG : Received response(xid=90): (b'somedata87', ZnodeStat(czxid=123, mzxid=123, ctime=1777502850099, mtime=1777502850099, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=123)) (connection.py:410, _read_response) 2026-04-29 22:47:50 [ 539 ] DEBUG : Sending request(xid=90): GetData(path='/test_snapshot_multinode_recover87', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:50 [ 539 ] DEBUG : Received response(xid=90): (b'somedata87', ZnodeStat(czxid=123, mzxid=123, ctime=1777502850099, mtime=1777502850099, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=123)) (connection.py:410, _read_response) 2026-04-29 22:47:50 [ 539 ] DEBUG : Sending request(xid=91): GetData(path='/test_snapshot_multinode_recover88', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:50 [ 539 ] DEBUG : Received response(xid=91): (b'somedata88', ZnodeStat(czxid=124, mzxid=124, ctime=1777502850118, mtime=1777502850118, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=124)) (connection.py:410, _read_response) 2026-04-29 22:47:50 [ 539 ] DEBUG : Sending request(xid=91): GetData(path='/test_snapshot_multinode_recover88', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:50 [ 539 ] DEBUG : Received response(xid=91): (b'somedata88', ZnodeStat(czxid=124, mzxid=124, ctime=1777502850118, mtime=1777502850118, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=124)) (connection.py:410, _read_response) 2026-04-29 22:47:50 [ 539 ] DEBUG : Sending request(xid=91): GetData(path='/test_snapshot_multinode_recover88', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:50 [ 539 ] DEBUG : Received response(xid=91): (b'somedata88', ZnodeStat(czxid=124, mzxid=124, ctime=1777502850118, mtime=1777502850118, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=124)) (connection.py:410, _read_response) 2026-04-29 22:47:50 [ 539 ] DEBUG : Sending request(xid=92): GetData(path='/test_snapshot_multinode_recover89', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:50 [ 539 ] DEBUG : Received response(xid=92): (b'somedata89', ZnodeStat(czxid=125, mzxid=125, ctime=1777502850155, mtime=1777502850155, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=125)) (connection.py:410, _read_response) 2026-04-29 22:47:50 [ 539 ] DEBUG : Sending request(xid=92): GetData(path='/test_snapshot_multinode_recover89', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:50 [ 539 ] DEBUG : Received response(xid=92): (b'somedata89', ZnodeStat(czxid=125, mzxid=125, ctime=1777502850155, mtime=1777502850155, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=125)) (connection.py:410, _read_response) 2026-04-29 22:47:50 [ 539 ] DEBUG : Sending request(xid=92): GetData(path='/test_snapshot_multinode_recover89', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:50 [ 539 ] DEBUG : Received response(xid=92): (b'somedata89', ZnodeStat(czxid=125, mzxid=125, ctime=1777502850155, mtime=1777502850155, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=125)) (connection.py:410, _read_response) 2026-04-29 22:47:50 [ 539 ] DEBUG : Sending request(xid=93): Exists(path='/test_snapshot_multinode_recover90', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:50 [ 539 ] DEBUG : Sending request(xid=93): Exists(path='/test_snapshot_multinode_recover90', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:51 [ 539 ] DEBUG : Sending request(xid=93): Exists(path='/test_snapshot_multinode_recover90', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:51 [ 539 ] DEBUG : Sending request(xid=94): GetData(path='/test_snapshot_multinode_recover91', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:51 [ 539 ] DEBUG : Received response(xid=94): (b'somedata91', ZnodeStat(czxid=127, mzxid=127, ctime=1777502850230, mtime=1777502850230, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=127)) (connection.py:410, _read_response) 2026-04-29 22:47:51 [ 539 ] DEBUG : Sending request(xid=94): GetData(path='/test_snapshot_multinode_recover91', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:51 [ 539 ] DEBUG : Received response(xid=94): (b'somedata91', ZnodeStat(czxid=127, mzxid=127, ctime=1777502850230, mtime=1777502850230, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=127)) (connection.py:410, _read_response) 2026-04-29 22:47:51 [ 539 ] DEBUG : Sending request(xid=94): GetData(path='/test_snapshot_multinode_recover91', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:51 [ 539 ] DEBUG : Received response(xid=94): (b'somedata91', ZnodeStat(czxid=127, mzxid=127, ctime=1777502850230, mtime=1777502850230, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=127)) (connection.py:410, _read_response) 2026-04-29 22:47:51 [ 539 ] DEBUG : Sending request(xid=95): GetData(path='/test_snapshot_multinode_recover92', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:51 [ 539 ] DEBUG : Received response(xid=95): (b'somedata92', ZnodeStat(czxid=128, mzxid=128, ctime=1777502850262, mtime=1777502850262, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=128)) (connection.py:410, _read_response) 2026-04-29 22:47:51 [ 539 ] DEBUG : Sending request(xid=95): GetData(path='/test_snapshot_multinode_recover92', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:51 [ 539 ] DEBUG : Received response(xid=95): (b'somedata92', ZnodeStat(czxid=128, mzxid=128, ctime=1777502850262, mtime=1777502850262, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=128)) (connection.py:410, _read_response) 2026-04-29 22:47:51 [ 539 ] DEBUG : Sending request(xid=95): GetData(path='/test_snapshot_multinode_recover92', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:51 [ 539 ] DEBUG : Received response(xid=95): (b'somedata92', ZnodeStat(czxid=128, mzxid=128, ctime=1777502850262, mtime=1777502850262, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=128)) (connection.py:410, _read_response) 2026-04-29 22:47:51 [ 539 ] DEBUG : Sending request(xid=96): GetData(path='/test_snapshot_multinode_recover93', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:51 [ 539 ] DEBUG : Received response(xid=96): (b'somedata93', ZnodeStat(czxid=129, mzxid=129, ctime=1777502850274, mtime=1777502850274, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=129)) (connection.py:410, _read_response) 2026-04-29 22:47:51 [ 539 ] WARNING : Connection dropped: socket connection error: None (connection.py:622, _connect_attempt) 2026-04-29 22:47:51 [ 539 ] DEBUG : Sending request(xid=96): GetData(path='/test_snapshot_multinode_recover93', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:51 [ 539 ] DEBUG : Received response(xid=96): (b'somedata93', ZnodeStat(czxid=129, mzxid=129, ctime=1777502850274, mtime=1777502850274, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=129)) (connection.py:410, _read_response) 2026-04-29 22:47:51 [ 539 ] DEBUG : Sending request(xid=96): GetData(path='/test_snapshot_multinode_recover93', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:51 [ 539 ] DEBUG : Received response(xid=96): (b'somedata93', ZnodeStat(czxid=129, mzxid=129, ctime=1777502850274, mtime=1777502850274, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=129)) (connection.py:410, _read_response) 2026-04-29 22:47:51 [ 539 ] DEBUG : Sending request(xid=97): GetData(path='/test_snapshot_multinode_recover94', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:51 [ 539 ] DEBUG : Received response(xid=97): (b'somedata94', ZnodeStat(czxid=130, mzxid=130, ctime=1777502850305, mtime=1777502850305, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=130)) (connection.py:410, _read_response) 2026-04-29 22:47:51 [ 539 ] DEBUG : Sending request(xid=97): GetData(path='/test_snapshot_multinode_recover94', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:51 [ 539 ] DEBUG : Received response(xid=97): (b'somedata94', ZnodeStat(czxid=130, mzxid=130, ctime=1777502850305, mtime=1777502850305, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=130)) (connection.py:410, _read_response) 2026-04-29 22:47:51 [ 539 ] DEBUG : Sending request(xid=97): GetData(path='/test_snapshot_multinode_recover94', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:51 [ 539 ] DEBUG : Received response(xid=97): (b'somedata94', ZnodeStat(czxid=130, mzxid=130, ctime=1777502850305, mtime=1777502850305, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=130)) (connection.py:410, _read_response) 2026-04-29 22:47:51 [ 539 ] DEBUG : Sending request(xid=98): GetData(path='/test_snapshot_multinode_recover95', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:51 [ 539 ] DEBUG : Received response(xid=98): (b'somedata95', ZnodeStat(czxid=131, mzxid=131, ctime=1777502850331, mtime=1777502850331, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=131)) (connection.py:410, _read_response) 2026-04-29 22:47:51 [ 539 ] DEBUG : Sending request(xid=98): GetData(path='/test_snapshot_multinode_recover95', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:51 [ 539 ] DEBUG : Received response(xid=98): (b'somedata95', ZnodeStat(czxid=131, mzxid=131, ctime=1777502850331, mtime=1777502850331, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=131)) (connection.py:410, _read_response) 2026-04-29 22:47:51 [ 539 ] DEBUG : Sending request(xid=98): GetData(path='/test_snapshot_multinode_recover95', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:51 [ 539 ] DEBUG : Received response(xid=98): (b'somedata95', ZnodeStat(czxid=131, mzxid=131, ctime=1777502850331, mtime=1777502850331, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=131)) (connection.py:410, _read_response) 2026-04-29 22:47:51 [ 539 ] DEBUG : Sending request(xid=99): GetData(path='/test_snapshot_multinode_recover96', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:51 [ 539 ] DEBUG : Received response(xid=99): (b'somedata96', ZnodeStat(czxid=132, mzxid=132, ctime=1777502850360, mtime=1777502850360, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=132)) (connection.py:410, _read_response) 2026-04-29 22:47:51 [ 539 ] DEBUG : Sending request(xid=99): GetData(path='/test_snapshot_multinode_recover96', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:51 [ 539 ] DEBUG : Received response(xid=99): (b'somedata96', ZnodeStat(czxid=132, mzxid=132, ctime=1777502850360, mtime=1777502850360, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=132)) (connection.py:410, _read_response) 2026-04-29 22:47:51 [ 539 ] DEBUG : Sending request(xid=99): GetData(path='/test_snapshot_multinode_recover96', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:51 [ 539 ] DEBUG : Received response(xid=99): (b'somedata96', ZnodeStat(czxid=132, mzxid=132, ctime=1777502850360, mtime=1777502850360, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=132)) (connection.py:410, _read_response) 2026-04-29 22:47:51 [ 539 ] DEBUG : Sending request(xid=100): GetData(path='/test_snapshot_multinode_recover97', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:51 [ 539 ] DEBUG : Received response(xid=100): (b'somedata97', ZnodeStat(czxid=133, mzxid=133, ctime=1777502850406, mtime=1777502850406, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=133)) (connection.py:410, _read_response) 2026-04-29 22:47:51 [ 539 ] DEBUG : Sending request(xid=100): GetData(path='/test_snapshot_multinode_recover97', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:51 [ 539 ] DEBUG : Received response(xid=100): (b'somedata97', ZnodeStat(czxid=133, mzxid=133, ctime=1777502850406, mtime=1777502850406, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=133)) (connection.py:410, _read_response) 2026-04-29 22:47:51 [ 539 ] DEBUG : Sending request(xid=100): GetData(path='/test_snapshot_multinode_recover97', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:51 [ 539 ] DEBUG : Received response(xid=100): (b'somedata97', ZnodeStat(czxid=133, mzxid=133, ctime=1777502850406, mtime=1777502850406, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=133)) (connection.py:410, _read_response) 2026-04-29 22:47:51 [ 539 ] DEBUG : Sending request(xid=101): GetData(path='/test_snapshot_multinode_recover98', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:51 [ 539 ] DEBUG : Received response(xid=101): (b'somedata98', ZnodeStat(czxid=134, mzxid=134, ctime=1777502850444, mtime=1777502850444, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=134)) (connection.py:410, _read_response) 2026-04-29 22:47:51 [ 539 ] DEBUG : Sending request(xid=101): GetData(path='/test_snapshot_multinode_recover98', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:51 [ 539 ] DEBUG : Received response(xid=101): (b'somedata98', ZnodeStat(czxid=134, mzxid=134, ctime=1777502850444, mtime=1777502850444, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=134)) (connection.py:410, _read_response) 2026-04-29 22:47:51 [ 539 ] DEBUG : Sending request(xid=101): GetData(path='/test_snapshot_multinode_recover98', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:51 [ 539 ] DEBUG : Received response(xid=101): (b'somedata98', ZnodeStat(czxid=134, mzxid=134, ctime=1777502850444, mtime=1777502850444, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=134)) (connection.py:410, _read_response) 2026-04-29 22:47:51 [ 539 ] DEBUG : Sending request(xid=102): GetData(path='/test_snapshot_multinode_recover99', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:51 [ 539 ] DEBUG : Received response(xid=102): (b'somedata99', ZnodeStat(czxid=135, mzxid=135, ctime=1777502850498, mtime=1777502850498, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=135)) (connection.py:410, _read_response) 2026-04-29 22:47:51 [ 539 ] DEBUG : Sending request(xid=102): GetData(path='/test_snapshot_multinode_recover99', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:51 [ 539 ] DEBUG : Received response(xid=102): (b'somedata99', ZnodeStat(czxid=135, mzxid=135, ctime=1777502850498, mtime=1777502850498, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=135)) (connection.py:410, _read_response) 2026-04-29 22:47:51 [ 539 ] DEBUG : Sending request(xid=102): GetData(path='/test_snapshot_multinode_recover99', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:51 [ 539 ] DEBUG : Received response(xid=102): (b'somedata99', ZnodeStat(czxid=135, mzxid=135, ctime=1777502850498, mtime=1777502850498, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=10, numChildren=0, pzxid=135)) (connection.py:410, _read_response) 2026-04-29 22:47:51 [ 539 ] DEBUG : Sending request(xid=103): Exists(path='/test_snapshot_multinode_recover100', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:51 [ 539 ] DEBUG : Sending request(xid=103): Exists(path='/test_snapshot_multinode_recover100', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:51 [ 539 ] DEBUG : Sending request(xid=103): Exists(path='/test_snapshot_multinode_recover100', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:51 [ 539 ] DEBUG : Sending request(xid=104): GetData(path='/test_snapshot_multinode_recover101', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:51 [ 539 ] DEBUG : Received response(xid=104): (b'somedata101', ZnodeStat(czxid=137, mzxid=137, ctime=1777502850560, mtime=1777502850560, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=137)) (connection.py:410, _read_response) 2026-04-29 22:47:51 [ 539 ] DEBUG : Sending request(xid=104): GetData(path='/test_snapshot_multinode_recover101', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:51 [ 539 ] DEBUG : Received response(xid=104): (b'somedata101', ZnodeStat(czxid=137, mzxid=137, ctime=1777502850560, mtime=1777502850560, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=137)) (connection.py:410, _read_response) 2026-04-29 22:47:51 [ 539 ] DEBUG : Sending request(xid=104): GetData(path='/test_snapshot_multinode_recover101', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:51 [ 539 ] DEBUG : Received response(xid=104): (b'somedata101', ZnodeStat(czxid=137, mzxid=137, ctime=1777502850560, mtime=1777502850560, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=137)) (connection.py:410, _read_response) 2026-04-29 22:47:51 [ 539 ] DEBUG : Sending request(xid=105): GetData(path='/test_snapshot_multinode_recover102', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:51 [ 539 ] DEBUG : Received response(xid=105): (b'somedata102', ZnodeStat(czxid=138, mzxid=138, ctime=1777502850618, mtime=1777502850618, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=138)) (connection.py:410, _read_response) 2026-04-29 22:47:51 [ 539 ] DEBUG : Sending request(xid=105): GetData(path='/test_snapshot_multinode_recover102', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:51 [ 539 ] DEBUG : Received response(xid=105): (b'somedata102', ZnodeStat(czxid=138, mzxid=138, ctime=1777502850618, mtime=1777502850618, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=138)) (connection.py:410, _read_response) 2026-04-29 22:47:51 [ 539 ] DEBUG : Sending request(xid=105): GetData(path='/test_snapshot_multinode_recover102', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:51 [ 539 ] DEBUG : Received response(xid=105): (b'somedata102', ZnodeStat(czxid=138, mzxid=138, ctime=1777502850618, mtime=1777502850618, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=138)) (connection.py:410, _read_response) 2026-04-29 22:47:51 [ 539 ] DEBUG : Sending request(xid=106): GetData(path='/test_snapshot_multinode_recover103', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:51 [ 539 ] DEBUG : Received response(xid=106): (b'somedata103', ZnodeStat(czxid=139, mzxid=139, ctime=1777502850644, mtime=1777502850644, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=139)) (connection.py:410, _read_response) 2026-04-29 22:47:51 [ 539 ] DEBUG : Sending request(xid=106): GetData(path='/test_snapshot_multinode_recover103', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:51 [ 539 ] DEBUG : Received response(xid=106): (b'somedata103', ZnodeStat(czxid=139, mzxid=139, ctime=1777502850644, mtime=1777502850644, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=139)) (connection.py:410, _read_response) 2026-04-29 22:47:51 [ 539 ] DEBUG : Sending request(xid=106): GetData(path='/test_snapshot_multinode_recover103', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:51 [ 539 ] DEBUG : Received response(xid=106): (b'somedata103', ZnodeStat(czxid=139, mzxid=139, ctime=1777502850644, mtime=1777502850644, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=139)) (connection.py:410, _read_response) 2026-04-29 22:47:51 [ 539 ] DEBUG : Sending request(xid=107): GetData(path='/test_snapshot_multinode_recover104', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:51 [ 539 ] DEBUG : Received response(xid=107): (b'somedata104', ZnodeStat(czxid=140, mzxid=140, ctime=1777502850669, mtime=1777502850669, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=140)) (connection.py:410, _read_response) 2026-04-29 22:47:51 [ 539 ] DEBUG : Sending request(xid=107): GetData(path='/test_snapshot_multinode_recover104', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:51 [ 539 ] DEBUG : Received response(xid=107): (b'somedata104', ZnodeStat(czxid=140, mzxid=140, ctime=1777502850669, mtime=1777502850669, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=140)) (connection.py:410, _read_response) 2026-04-29 22:47:51 [ 539 ] DEBUG : Sending request(xid=107): GetData(path='/test_snapshot_multinode_recover104', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:51 [ 539 ] DEBUG : Received response(xid=107): (b'somedata104', ZnodeStat(czxid=140, mzxid=140, ctime=1777502850669, mtime=1777502850669, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=140)) (connection.py:410, _read_response) 2026-04-29 22:47:51 [ 539 ] DEBUG : Sending request(xid=108): GetData(path='/test_snapshot_multinode_recover105', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:51 [ 539 ] DEBUG : Received response(xid=108): (b'somedata105', ZnodeStat(czxid=141, mzxid=141, ctime=1777502850692, mtime=1777502850692, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=141)) (connection.py:410, _read_response) 2026-04-29 22:47:51 [ 539 ] DEBUG : Sending request(xid=108): GetData(path='/test_snapshot_multinode_recover105', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:51 [ 539 ] DEBUG : Received response(xid=108): (b'somedata105', ZnodeStat(czxid=141, mzxid=141, ctime=1777502850692, mtime=1777502850692, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=141)) (connection.py:410, _read_response) 2026-04-29 22:47:51 [ 539 ] DEBUG : Sending request(xid=108): GetData(path='/test_snapshot_multinode_recover105', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:51 [ 539 ] DEBUG : Received response(xid=108): (b'somedata105', ZnodeStat(czxid=141, mzxid=141, ctime=1777502850692, mtime=1777502850692, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=141)) (connection.py:410, _read_response) 2026-04-29 22:47:51 [ 539 ] DEBUG : Sending request(xid=109): GetData(path='/test_snapshot_multinode_recover106', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:51 [ 539 ] DEBUG : Received response(xid=109): (b'somedata106', ZnodeStat(czxid=142, mzxid=142, ctime=1777502850712, mtime=1777502850712, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=142)) (connection.py:410, _read_response) 2026-04-29 22:47:51 [ 539 ] DEBUG : Sending request(xid=109): GetData(path='/test_snapshot_multinode_recover106', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:51 [ 539 ] DEBUG : Received response(xid=109): (b'somedata106', ZnodeStat(czxid=142, mzxid=142, ctime=1777502850712, mtime=1777502850712, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=142)) (connection.py:410, _read_response) 2026-04-29 22:47:51 [ 539 ] DEBUG : Sending request(xid=109): GetData(path='/test_snapshot_multinode_recover106', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:51 [ 539 ] DEBUG : Received response(xid=109): (b'somedata106', ZnodeStat(czxid=142, mzxid=142, ctime=1777502850712, mtime=1777502850712, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=142)) (connection.py:410, _read_response) 2026-04-29 22:47:51 [ 539 ] DEBUG : Sending request(xid=110): GetData(path='/test_snapshot_multinode_recover107', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:51 [ 539 ] DEBUG : Received response(xid=110): (b'somedata107', ZnodeStat(czxid=143, mzxid=143, ctime=1777502850724, mtime=1777502850724, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=143)) (connection.py:410, _read_response) 2026-04-29 22:47:51 [ 539 ] DEBUG : Sending request(xid=110): GetData(path='/test_snapshot_multinode_recover107', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:51 [ 539 ] DEBUG : Received response(xid=110): (b'somedata107', ZnodeStat(czxid=143, mzxid=143, ctime=1777502850724, mtime=1777502850724, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=143)) (connection.py:410, _read_response) 2026-04-29 22:47:51 [ 539 ] DEBUG : Sending request(xid=110): GetData(path='/test_snapshot_multinode_recover107', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:51 [ 539 ] DEBUG : Received response(xid=110): (b'somedata107', ZnodeStat(czxid=143, mzxid=143, ctime=1777502850724, mtime=1777502850724, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=143)) (connection.py:410, _read_response) 2026-04-29 22:47:51 [ 539 ] DEBUG : Sending request(xid=111): GetData(path='/test_snapshot_multinode_recover108', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:51 [ 539 ] DEBUG : Received response(xid=111): (b'somedata108', ZnodeStat(czxid=144, mzxid=144, ctime=1777502850739, mtime=1777502850739, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=144)) (connection.py:410, _read_response) 2026-04-29 22:47:51 [ 539 ] DEBUG : Sending request(xid=111): GetData(path='/test_snapshot_multinode_recover108', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:51 [ 539 ] DEBUG : Received response(xid=111): (b'somedata108', ZnodeStat(czxid=144, mzxid=144, ctime=1777502850739, mtime=1777502850739, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=144)) (connection.py:410, _read_response) 2026-04-29 22:47:51 [ 539 ] DEBUG : Sending request(xid=111): GetData(path='/test_snapshot_multinode_recover108', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:51 [ 539 ] DEBUG : Received response(xid=111): (b'somedata108', ZnodeStat(czxid=144, mzxid=144, ctime=1777502850739, mtime=1777502850739, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=144)) (connection.py:410, _read_response) 2026-04-29 22:47:51 [ 539 ] DEBUG : Sending request(xid=112): GetData(path='/test_snapshot_multinode_recover109', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:51 [ 539 ] DEBUG : Received response(xid=112): (b'somedata109', ZnodeStat(czxid=145, mzxid=145, ctime=1777502850763, mtime=1777502850763, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=145)) (connection.py:410, _read_response) 2026-04-29 22:47:51 [ 539 ] DEBUG : Sending request(xid=112): GetData(path='/test_snapshot_multinode_recover109', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:51 [ 539 ] DEBUG : Received response(xid=112): (b'somedata109', ZnodeStat(czxid=145, mzxid=145, ctime=1777502850763, mtime=1777502850763, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=145)) (connection.py:410, _read_response) 2026-04-29 22:47:51 [ 539 ] DEBUG : Sending request(xid=112): GetData(path='/test_snapshot_multinode_recover109', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:51 [ 539 ] DEBUG : Received response(xid=112): (b'somedata109', ZnodeStat(czxid=145, mzxid=145, ctime=1777502850763, mtime=1777502850763, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=145)) (connection.py:410, _read_response) 2026-04-29 22:47:51 [ 539 ] DEBUG : Sending request(xid=113): Exists(path='/test_snapshot_multinode_recover110', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:51 [ 539 ] DEBUG : Sending request(xid=113): Exists(path='/test_snapshot_multinode_recover110', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:51 [ 539 ] DEBUG : Sending request(xid=113): Exists(path='/test_snapshot_multinode_recover110', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:51 [ 539 ] DEBUG : Sending request(xid=114): GetData(path='/test_snapshot_multinode_recover111', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:51 [ 539 ] DEBUG : Received response(xid=114): (b'somedata111', ZnodeStat(czxid=147, mzxid=147, ctime=1777502850812, mtime=1777502850812, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=147)) (connection.py:410, _read_response) 2026-04-29 22:47:51 [ 539 ] DEBUG : Sending request(xid=114): GetData(path='/test_snapshot_multinode_recover111', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:51 [ 539 ] DEBUG : Received response(xid=114): (b'somedata111', ZnodeStat(czxid=147, mzxid=147, ctime=1777502850812, mtime=1777502850812, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=147)) (connection.py:410, _read_response) 2026-04-29 22:47:51 [ 539 ] DEBUG : Sending request(xid=114): GetData(path='/test_snapshot_multinode_recover111', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:51 [ 539 ] DEBUG : Received response(xid=114): (b'somedata111', ZnodeStat(czxid=147, mzxid=147, ctime=1777502850812, mtime=1777502850812, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=147)) (connection.py:410, _read_response) 2026-04-29 22:47:51 [ 539 ] DEBUG : Sending request(xid=115): GetData(path='/test_snapshot_multinode_recover112', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:51 [ 539 ] DEBUG : Received response(xid=115): (b'somedata112', ZnodeStat(czxid=148, mzxid=148, ctime=1777502850828, mtime=1777502850828, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=148)) (connection.py:410, _read_response) 2026-04-29 22:47:51 [ 539 ] DEBUG : Sending request(xid=115): GetData(path='/test_snapshot_multinode_recover112', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:51 [ 539 ] DEBUG : Received response(xid=115): (b'somedata112', ZnodeStat(czxid=148, mzxid=148, ctime=1777502850828, mtime=1777502850828, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=148)) (connection.py:410, _read_response) 2026-04-29 22:47:51 [ 539 ] DEBUG : Sending request(xid=115): GetData(path='/test_snapshot_multinode_recover112', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:51 [ 539 ] DEBUG : Received response(xid=115): (b'somedata112', ZnodeStat(czxid=148, mzxid=148, ctime=1777502850828, mtime=1777502850828, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=148)) (connection.py:410, _read_response) 2026-04-29 22:47:51 [ 539 ] DEBUG : Sending request(xid=116): GetData(path='/test_snapshot_multinode_recover113', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:51 [ 539 ] DEBUG : Received response(xid=116): (b'somedata113', ZnodeStat(czxid=149, mzxid=149, ctime=1777502850845, mtime=1777502850845, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=149)) (connection.py:410, _read_response) 2026-04-29 22:47:51 [ 539 ] DEBUG : Sending request(xid=116): GetData(path='/test_snapshot_multinode_recover113', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:51 [ 539 ] DEBUG : Received response(xid=116): (b'somedata113', ZnodeStat(czxid=149, mzxid=149, ctime=1777502850845, mtime=1777502850845, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=149)) (connection.py:410, _read_response) 2026-04-29 22:47:51 [ 539 ] DEBUG : Sending request(xid=116): GetData(path='/test_snapshot_multinode_recover113', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:51 [ 539 ] DEBUG : Received response(xid=116): (b'somedata113', ZnodeStat(czxid=149, mzxid=149, ctime=1777502850845, mtime=1777502850845, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=149)) (connection.py:410, _read_response) 2026-04-29 22:47:51 [ 539 ] DEBUG : Sending request(xid=117): GetData(path='/test_snapshot_multinode_recover114', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:51 [ 539 ] DEBUG : Received response(xid=117): (b'somedata114', ZnodeStat(czxid=150, mzxid=150, ctime=1777502850865, mtime=1777502850865, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=150)) (connection.py:410, _read_response) 2026-04-29 22:47:51 [ 539 ] DEBUG : Sending request(xid=117): GetData(path='/test_snapshot_multinode_recover114', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:51 [ 539 ] DEBUG : Received response(xid=117): (b'somedata114', ZnodeStat(czxid=150, mzxid=150, ctime=1777502850865, mtime=1777502850865, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=150)) (connection.py:410, _read_response) 2026-04-29 22:47:51 [ 539 ] DEBUG : Sending request(xid=117): GetData(path='/test_snapshot_multinode_recover114', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:51 [ 539 ] DEBUG : Received response(xid=117): (b'somedata114', ZnodeStat(czxid=150, mzxid=150, ctime=1777502850865, mtime=1777502850865, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=150)) (connection.py:410, _read_response) 2026-04-29 22:47:51 [ 539 ] DEBUG : Sending request(xid=118): GetData(path='/test_snapshot_multinode_recover115', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:51 [ 539 ] DEBUG : Received response(xid=118): (b'somedata115', ZnodeStat(czxid=151, mzxid=151, ctime=1777502850879, mtime=1777502850879, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=151)) (connection.py:410, _read_response) 2026-04-29 22:47:51 [ 539 ] DEBUG : Sending request(xid=118): GetData(path='/test_snapshot_multinode_recover115', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:51 [ 539 ] DEBUG : Received response(xid=118): (b'somedata115', ZnodeStat(czxid=151, mzxid=151, ctime=1777502850879, mtime=1777502850879, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=151)) (connection.py:410, _read_response) 2026-04-29 22:47:51 [ 539 ] DEBUG : Sending request(xid=118): GetData(path='/test_snapshot_multinode_recover115', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:51 [ 539 ] DEBUG : Received response(xid=118): (b'somedata115', ZnodeStat(czxid=151, mzxid=151, ctime=1777502850879, mtime=1777502850879, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=151)) (connection.py:410, _read_response) 2026-04-29 22:47:51 [ 539 ] DEBUG : Sending request(xid=119): GetData(path='/test_snapshot_multinode_recover116', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:51 [ 539 ] DEBUG : Received response(xid=119): (b'somedata116', ZnodeStat(czxid=152, mzxid=152, ctime=1777502850890, mtime=1777502850890, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=152)) (connection.py:410, _read_response) 2026-04-29 22:47:51 [ 539 ] DEBUG : Sending request(xid=119): GetData(path='/test_snapshot_multinode_recover116', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:51 [ 539 ] DEBUG : Received response(xid=119): (b'somedata116', ZnodeStat(czxid=152, mzxid=152, ctime=1777502850890, mtime=1777502850890, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=152)) (connection.py:410, _read_response) 2026-04-29 22:47:51 [ 539 ] DEBUG : Sending request(xid=119): GetData(path='/test_snapshot_multinode_recover116', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:51 [ 539 ] DEBUG : Received response(xid=119): (b'somedata116', ZnodeStat(czxid=152, mzxid=152, ctime=1777502850890, mtime=1777502850890, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=152)) (connection.py:410, _read_response) 2026-04-29 22:47:51 [ 539 ] DEBUG : Sending request(xid=120): GetData(path='/test_snapshot_multinode_recover117', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:51 [ 539 ] DEBUG : Received response(xid=120): (b'somedata117', ZnodeStat(czxid=153, mzxid=153, ctime=1777502850926, mtime=1777502850926, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=153)) (connection.py:410, _read_response) 2026-04-29 22:47:51 [ 539 ] DEBUG : Sending request(xid=120): GetData(path='/test_snapshot_multinode_recover117', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:51 [ 539 ] DEBUG : Received response(xid=120): (b'somedata117', ZnodeStat(czxid=153, mzxid=153, ctime=1777502850926, mtime=1777502850926, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=153)) (connection.py:410, _read_response) 2026-04-29 22:47:51 [ 539 ] DEBUG : Sending request(xid=120): GetData(path='/test_snapshot_multinode_recover117', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:51 [ 539 ] DEBUG : Received response(xid=120): (b'somedata117', ZnodeStat(czxid=153, mzxid=153, ctime=1777502850926, mtime=1777502850926, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=153)) (connection.py:410, _read_response) 2026-04-29 22:47:51 [ 539 ] DEBUG : Sending request(xid=121): GetData(path='/test_snapshot_multinode_recover118', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:51 [ 539 ] DEBUG : Received response(xid=121): (b'somedata118', ZnodeStat(czxid=154, mzxid=154, ctime=1777502850972, mtime=1777502850972, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=154)) (connection.py:410, _read_response) 2026-04-29 22:47:52 [ 539 ] DEBUG : Sending request(xid=121): GetData(path='/test_snapshot_multinode_recover118', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:52 [ 539 ] DEBUG : Received response(xid=121): (b'somedata118', ZnodeStat(czxid=154, mzxid=154, ctime=1777502850972, mtime=1777502850972, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=154)) (connection.py:410, _read_response) 2026-04-29 22:47:52 [ 539 ] DEBUG : Sending request(xid=121): GetData(path='/test_snapshot_multinode_recover118', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:52 [ 539 ] DEBUG : Received response(xid=121): (b'somedata118', ZnodeStat(czxid=154, mzxid=154, ctime=1777502850972, mtime=1777502850972, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=154)) (connection.py:410, _read_response) 2026-04-29 22:47:52 [ 539 ] DEBUG : Sending request(xid=122): GetData(path='/test_snapshot_multinode_recover119', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:52 [ 539 ] DEBUG : Received response(xid=122): (b'somedata119', ZnodeStat(czxid=155, mzxid=155, ctime=1777502850993, mtime=1777502850993, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=155)) (connection.py:410, _read_response) 2026-04-29 22:47:52 [ 539 ] DEBUG : Sending request(xid=122): GetData(path='/test_snapshot_multinode_recover119', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:52 [ 539 ] DEBUG : Received response(xid=122): (b'somedata119', ZnodeStat(czxid=155, mzxid=155, ctime=1777502850993, mtime=1777502850993, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=155)) (connection.py:410, _read_response) 2026-04-29 22:47:52 [ 539 ] DEBUG : Sending request(xid=122): GetData(path='/test_snapshot_multinode_recover119', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:52 [ 539 ] DEBUG : Received response(xid=122): (b'somedata119', ZnodeStat(czxid=155, mzxid=155, ctime=1777502850993, mtime=1777502850993, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=155)) (connection.py:410, _read_response) 2026-04-29 22:47:52 [ 539 ] DEBUG : Sending request(xid=123): Exists(path='/test_snapshot_multinode_recover120', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:52 [ 539 ] DEBUG : Sending request(xid=123): Exists(path='/test_snapshot_multinode_recover120', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:52 [ 539 ] DEBUG : Sending request(xid=123): Exists(path='/test_snapshot_multinode_recover120', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:52 [ 539 ] DEBUG : Sending request(xid=124): GetData(path='/test_snapshot_multinode_recover121', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:52 [ 539 ] DEBUG : Received response(xid=124): (b'somedata121', ZnodeStat(czxid=157, mzxid=157, ctime=1777502851061, mtime=1777502851061, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=157)) (connection.py:410, _read_response) 2026-04-29 22:47:52 [ 539 ] DEBUG : Sending request(xid=124): GetData(path='/test_snapshot_multinode_recover121', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:52 [ 539 ] DEBUG : Received response(xid=124): (b'somedata121', ZnodeStat(czxid=157, mzxid=157, ctime=1777502851061, mtime=1777502851061, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=157)) (connection.py:410, _read_response) 2026-04-29 22:47:52 [ 539 ] DEBUG : Sending request(xid=124): GetData(path='/test_snapshot_multinode_recover121', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:52 [ 539 ] DEBUG : Received response(xid=124): (b'somedata121', ZnodeStat(czxid=157, mzxid=157, ctime=1777502851061, mtime=1777502851061, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=157)) (connection.py:410, _read_response) 2026-04-29 22:47:52 [ 539 ] DEBUG : Sending request(xid=125): GetData(path='/test_snapshot_multinode_recover122', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:52 [ 539 ] DEBUG : Received response(xid=125): (b'somedata122', ZnodeStat(czxid=158, mzxid=158, ctime=1777502851090, mtime=1777502851090, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=158)) (connection.py:410, _read_response) 2026-04-29 22:47:52 [ 539 ] DEBUG : Sending request(xid=125): GetData(path='/test_snapshot_multinode_recover122', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:52 [ 539 ] DEBUG : Received response(xid=125): (b'somedata122', ZnodeStat(czxid=158, mzxid=158, ctime=1777502851090, mtime=1777502851090, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=158)) (connection.py:410, _read_response) 2026-04-29 22:47:52 [ 539 ] DEBUG : Sending request(xid=125): GetData(path='/test_snapshot_multinode_recover122', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:52 [ 539 ] DEBUG : Received response(xid=125): (b'somedata122', ZnodeStat(czxid=158, mzxid=158, ctime=1777502851090, mtime=1777502851090, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=158)) (connection.py:410, _read_response) 2026-04-29 22:47:52 [ 539 ] DEBUG : Sending request(xid=126): GetData(path='/test_snapshot_multinode_recover123', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:52 [ 539 ] DEBUG : Received response(xid=126): (b'somedata123', ZnodeStat(czxid=159, mzxid=159, ctime=1777502851115, mtime=1777502851115, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=159)) (connection.py:410, _read_response) 2026-04-29 22:47:52 [ 539 ] DEBUG : Sending request(xid=126): GetData(path='/test_snapshot_multinode_recover123', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:52 [ 539 ] DEBUG : Received response(xid=126): (b'somedata123', ZnodeStat(czxid=159, mzxid=159, ctime=1777502851115, mtime=1777502851115, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=159)) (connection.py:410, _read_response) 2026-04-29 22:47:52 [ 539 ] DEBUG : Sending request(xid=126): GetData(path='/test_snapshot_multinode_recover123', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:52 [ 539 ] DEBUG : Received response(xid=126): (b'somedata123', ZnodeStat(czxid=159, mzxid=159, ctime=1777502851115, mtime=1777502851115, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=159)) (connection.py:410, _read_response) 2026-04-29 22:47:52 [ 539 ] DEBUG : Sending request(xid=127): GetData(path='/test_snapshot_multinode_recover124', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:52 [ 539 ] DEBUG : Received response(xid=127): (b'somedata124', ZnodeStat(czxid=160, mzxid=160, ctime=1777502851143, mtime=1777502851143, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=160)) (connection.py:410, _read_response) 2026-04-29 22:47:52 [ 539 ] DEBUG : Sending request(xid=127): GetData(path='/test_snapshot_multinode_recover124', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:52 [ 539 ] DEBUG : Received response(xid=127): (b'somedata124', ZnodeStat(czxid=160, mzxid=160, ctime=1777502851143, mtime=1777502851143, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=160)) (connection.py:410, _read_response) 2026-04-29 22:47:52 [ 539 ] DEBUG : Sending request(xid=127): GetData(path='/test_snapshot_multinode_recover124', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:52 [ 539 ] DEBUG : Received response(xid=127): (b'somedata124', ZnodeStat(czxid=160, mzxid=160, ctime=1777502851143, mtime=1777502851143, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=160)) (connection.py:410, _read_response) 2026-04-29 22:47:52 [ 539 ] DEBUG : Sending request(xid=128): GetData(path='/test_snapshot_multinode_recover125', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:52 [ 539 ] DEBUG : Received response(xid=128): (b'somedata125', ZnodeStat(czxid=161, mzxid=161, ctime=1777502851169, mtime=1777502851169, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=161)) (connection.py:410, _read_response) 2026-04-29 22:47:52 [ 539 ] DEBUG : Sending request(xid=128): GetData(path='/test_snapshot_multinode_recover125', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:52 [ 539 ] DEBUG : Received response(xid=128): (b'somedata125', ZnodeStat(czxid=161, mzxid=161, ctime=1777502851169, mtime=1777502851169, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=161)) (connection.py:410, _read_response) 2026-04-29 22:47:52 [ 539 ] DEBUG : Sending request(xid=128): GetData(path='/test_snapshot_multinode_recover125', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:52 [ 539 ] DEBUG : Received response(xid=128): (b'somedata125', ZnodeStat(czxid=161, mzxid=161, ctime=1777502851169, mtime=1777502851169, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=161)) (connection.py:410, _read_response) 2026-04-29 22:47:52 [ 539 ] DEBUG : Sending request(xid=129): GetData(path='/test_snapshot_multinode_recover126', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:52 [ 539 ] DEBUG : Received response(xid=129): (b'somedata126', ZnodeStat(czxid=162, mzxid=162, ctime=1777502851210, mtime=1777502851210, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=162)) (connection.py:410, _read_response) 2026-04-29 22:47:52 [ 539 ] DEBUG : Sending request(xid=129): GetData(path='/test_snapshot_multinode_recover126', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:52 [ 539 ] DEBUG : Received response(xid=129): (b'somedata126', ZnodeStat(czxid=162, mzxid=162, ctime=1777502851210, mtime=1777502851210, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=162)) (connection.py:410, _read_response) 2026-04-29 22:47:52 [ 539 ] DEBUG : Sending request(xid=129): GetData(path='/test_snapshot_multinode_recover126', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:52 [ 539 ] DEBUG : Received response(xid=129): (b'somedata126', ZnodeStat(czxid=162, mzxid=162, ctime=1777502851210, mtime=1777502851210, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=162)) (connection.py:410, _read_response) 2026-04-29 22:47:52 [ 539 ] DEBUG : Sending request(xid=130): GetData(path='/test_snapshot_multinode_recover127', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:52 [ 539 ] DEBUG : Received response(xid=130): (b'somedata127', ZnodeStat(czxid=163, mzxid=163, ctime=1777502851249, mtime=1777502851249, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=163)) (connection.py:410, _read_response) 2026-04-29 22:47:52 [ 539 ] DEBUG : Sending request(xid=130): GetData(path='/test_snapshot_multinode_recover127', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:52 [ 539 ] DEBUG : Received response(xid=130): (b'somedata127', ZnodeStat(czxid=163, mzxid=163, ctime=1777502851249, mtime=1777502851249, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=163)) (connection.py:410, _read_response) 2026-04-29 22:47:52 [ 539 ] DEBUG : Sending request(xid=130): GetData(path='/test_snapshot_multinode_recover127', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:52 [ 539 ] DEBUG : Received response(xid=130): (b'somedata127', ZnodeStat(czxid=163, mzxid=163, ctime=1777502851249, mtime=1777502851249, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=163)) (connection.py:410, _read_response) 2026-04-29 22:47:52 [ 539 ] DEBUG : Sending request(xid=131): GetData(path='/test_snapshot_multinode_recover128', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:52 [ 539 ] DEBUG : Received response(xid=131): (b'somedata128', ZnodeStat(czxid=164, mzxid=164, ctime=1777502851269, mtime=1777502851269, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=164)) (connection.py:410, _read_response) 2026-04-29 22:47:52 [ 539 ] DEBUG : Sending request(xid=131): GetData(path='/test_snapshot_multinode_recover128', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:52 [ 539 ] DEBUG : Received response(xid=131): (b'somedata128', ZnodeStat(czxid=164, mzxid=164, ctime=1777502851269, mtime=1777502851269, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=164)) (connection.py:410, _read_response) 2026-04-29 22:47:52 [ 539 ] DEBUG : Sending request(xid=131): GetData(path='/test_snapshot_multinode_recover128', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:52 [ 539 ] DEBUG : Received response(xid=131): (b'somedata128', ZnodeStat(czxid=164, mzxid=164, ctime=1777502851269, mtime=1777502851269, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=164)) (connection.py:410, _read_response) 2026-04-29 22:47:52 [ 539 ] DEBUG : Sending request(xid=132): GetData(path='/test_snapshot_multinode_recover129', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:52 [ 539 ] DEBUG : Received response(xid=132): (b'somedata129', ZnodeStat(czxid=165, mzxid=165, ctime=1777502851291, mtime=1777502851291, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=165)) (connection.py:410, _read_response) 2026-04-29 22:47:52 [ 539 ] DEBUG : Sending request(xid=132): GetData(path='/test_snapshot_multinode_recover129', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:52 [ 539 ] DEBUG : Received response(xid=132): (b'somedata129', ZnodeStat(czxid=165, mzxid=165, ctime=1777502851291, mtime=1777502851291, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=165)) (connection.py:410, _read_response) 2026-04-29 22:47:52 [ 539 ] DEBUG : Sending request(xid=132): GetData(path='/test_snapshot_multinode_recover129', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:52 [ 539 ] DEBUG : Received response(xid=132): (b'somedata129', ZnodeStat(czxid=165, mzxid=165, ctime=1777502851291, mtime=1777502851291, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=165)) (connection.py:410, _read_response) 2026-04-29 22:47:52 [ 539 ] DEBUG : Sending request(xid=133): Exists(path='/test_snapshot_multinode_recover130', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:52 [ 539 ] DEBUG : Sending request(xid=133): Exists(path='/test_snapshot_multinode_recover130', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:52 [ 539 ] DEBUG : Sending request(xid=133): Exists(path='/test_snapshot_multinode_recover130', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:52 [ 539 ] DEBUG : Sending request(xid=134): GetData(path='/test_snapshot_multinode_recover131', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:52 [ 539 ] DEBUG : Received response(xid=134): (b'somedata131', ZnodeStat(czxid=167, mzxid=167, ctime=1777502851333, mtime=1777502851333, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=167)) (connection.py:410, _read_response) 2026-04-29 22:47:52 [ 539 ] DEBUG : Sending request(xid=134): GetData(path='/test_snapshot_multinode_recover131', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:52 [ 539 ] DEBUG : Received response(xid=134): (b'somedata131', ZnodeStat(czxid=167, mzxid=167, ctime=1777502851333, mtime=1777502851333, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=167)) (connection.py:410, _read_response) 2026-04-29 22:47:52 [ 539 ] DEBUG : Sending request(xid=134): GetData(path='/test_snapshot_multinode_recover131', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:52 [ 539 ] DEBUG : Received response(xid=134): (b'somedata131', ZnodeStat(czxid=167, mzxid=167, ctime=1777502851333, mtime=1777502851333, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=167)) (connection.py:410, _read_response) 2026-04-29 22:47:52 [ 539 ] DEBUG : Sending request(xid=135): GetData(path='/test_snapshot_multinode_recover132', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:52 [ 539 ] DEBUG : Received response(xid=135): (b'somedata132', ZnodeStat(czxid=168, mzxid=168, ctime=1777502851366, mtime=1777502851366, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=168)) (connection.py:410, _read_response) 2026-04-29 22:47:52 [ 539 ] DEBUG : Sending request(xid=135): GetData(path='/test_snapshot_multinode_recover132', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:52 [ 539 ] DEBUG : Received response(xid=135): (b'somedata132', ZnodeStat(czxid=168, mzxid=168, ctime=1777502851366, mtime=1777502851366, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=168)) (connection.py:410, _read_response) 2026-04-29 22:47:52 [ 539 ] DEBUG : Sending request(xid=135): GetData(path='/test_snapshot_multinode_recover132', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:52 [ 539 ] DEBUG : Received response(xid=135): (b'somedata132', ZnodeStat(czxid=168, mzxid=168, ctime=1777502851366, mtime=1777502851366, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=168)) (connection.py:410, _read_response) 2026-04-29 22:47:52 [ 539 ] DEBUG : Sending request(xid=136): GetData(path='/test_snapshot_multinode_recover133', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:52 [ 539 ] DEBUG : Received response(xid=136): (b'somedata133', ZnodeStat(czxid=169, mzxid=169, ctime=1777502851399, mtime=1777502851399, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=169)) (connection.py:410, _read_response) 2026-04-29 22:47:52 [ 539 ] DEBUG : Sending request(xid=136): GetData(path='/test_snapshot_multinode_recover133', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:52 [ 539 ] DEBUG : Received response(xid=136): (b'somedata133', ZnodeStat(czxid=169, mzxid=169, ctime=1777502851399, mtime=1777502851399, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=169)) (connection.py:410, _read_response) 2026-04-29 22:47:52 [ 539 ] DEBUG : Sending request(xid=136): GetData(path='/test_snapshot_multinode_recover133', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:52 [ 539 ] DEBUG : Received response(xid=136): (b'somedata133', ZnodeStat(czxid=169, mzxid=169, ctime=1777502851399, mtime=1777502851399, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=169)) (connection.py:410, _read_response) 2026-04-29 22:47:52 [ 539 ] DEBUG : Sending request(xid=137): GetData(path='/test_snapshot_multinode_recover134', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:52 [ 539 ] DEBUG : Received response(xid=137): (b'somedata134', ZnodeStat(czxid=170, mzxid=170, ctime=1777502851428, mtime=1777502851428, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=170)) (connection.py:410, _read_response) 2026-04-29 22:47:52 [ 539 ] DEBUG : Sending request(xid=137): GetData(path='/test_snapshot_multinode_recover134', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:52 [ 539 ] DEBUG : Received response(xid=137): (b'somedata134', ZnodeStat(czxid=170, mzxid=170, ctime=1777502851428, mtime=1777502851428, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=170)) (connection.py:410, _read_response) 2026-04-29 22:47:52 [ 539 ] DEBUG : Sending request(xid=137): GetData(path='/test_snapshot_multinode_recover134', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:52 [ 539 ] DEBUG : Received response(xid=137): (b'somedata134', ZnodeStat(czxid=170, mzxid=170, ctime=1777502851428, mtime=1777502851428, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=170)) (connection.py:410, _read_response) 2026-04-29 22:47:52 [ 539 ] DEBUG : Sending request(xid=138): GetData(path='/test_snapshot_multinode_recover135', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:52 [ 539 ] DEBUG : Received response(xid=138): (b'somedata135', ZnodeStat(czxid=171, mzxid=171, ctime=1777502851464, mtime=1777502851464, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=171)) (connection.py:410, _read_response) 2026-04-29 22:47:52 [ 539 ] DEBUG : Sending request(xid=138): GetData(path='/test_snapshot_multinode_recover135', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:52 [ 539 ] DEBUG : Received response(xid=138): (b'somedata135', ZnodeStat(czxid=171, mzxid=171, ctime=1777502851464, mtime=1777502851464, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=171)) (connection.py:410, _read_response) 2026-04-29 22:47:52 [ 539 ] DEBUG : Sending request(xid=138): GetData(path='/test_snapshot_multinode_recover135', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:52 [ 539 ] DEBUG : Received response(xid=138): (b'somedata135', ZnodeStat(czxid=171, mzxid=171, ctime=1777502851464, mtime=1777502851464, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=171)) (connection.py:410, _read_response) 2026-04-29 22:47:52 [ 539 ] DEBUG : Sending request(xid=139): GetData(path='/test_snapshot_multinode_recover136', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:52 [ 539 ] DEBUG : Received response(xid=139): (b'somedata136', ZnodeStat(czxid=172, mzxid=172, ctime=1777502851497, mtime=1777502851497, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=172)) (connection.py:410, _read_response) 2026-04-29 22:47:52 [ 539 ] DEBUG : Sending request(xid=139): GetData(path='/test_snapshot_multinode_recover136', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:52 [ 539 ] DEBUG : Received response(xid=139): (b'somedata136', ZnodeStat(czxid=172, mzxid=172, ctime=1777502851497, mtime=1777502851497, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=172)) (connection.py:410, _read_response) 2026-04-29 22:47:52 [ 539 ] DEBUG : Sending request(xid=139): GetData(path='/test_snapshot_multinode_recover136', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:52 [ 539 ] DEBUG : Received response(xid=139): (b'somedata136', ZnodeStat(czxid=172, mzxid=172, ctime=1777502851497, mtime=1777502851497, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=172)) (connection.py:410, _read_response) 2026-04-29 22:47:52 [ 539 ] DEBUG : Sending request(xid=140): GetData(path='/test_snapshot_multinode_recover137', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:52 [ 539 ] DEBUG : Received response(xid=140): (b'somedata137', ZnodeStat(czxid=173, mzxid=173, ctime=1777502851532, mtime=1777502851532, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=173)) (connection.py:410, _read_response) 2026-04-29 22:47:52 [ 539 ] DEBUG : Sending request(xid=140): GetData(path='/test_snapshot_multinode_recover137', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:52 [ 539 ] DEBUG : Received response(xid=140): (b'somedata137', ZnodeStat(czxid=173, mzxid=173, ctime=1777502851532, mtime=1777502851532, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=173)) (connection.py:410, _read_response) 2026-04-29 22:47:52 [ 539 ] DEBUG : Sending request(xid=140): GetData(path='/test_snapshot_multinode_recover137', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:52 [ 539 ] DEBUG : Received response(xid=140): (b'somedata137', ZnodeStat(czxid=173, mzxid=173, ctime=1777502851532, mtime=1777502851532, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=173)) (connection.py:410, _read_response) 2026-04-29 22:47:52 [ 539 ] DEBUG : Sending request(xid=141): GetData(path='/test_snapshot_multinode_recover138', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:52 [ 539 ] DEBUG : Received response(xid=141): (b'somedata138', ZnodeStat(czxid=174, mzxid=174, ctime=1777502851584, mtime=1777502851584, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=174)) (connection.py:410, _read_response) 2026-04-29 22:47:52 [ 539 ] DEBUG : Sending request(xid=141): GetData(path='/test_snapshot_multinode_recover138', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:52 [ 539 ] DEBUG : Received response(xid=141): (b'somedata138', ZnodeStat(czxid=174, mzxid=174, ctime=1777502851584, mtime=1777502851584, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=174)) (connection.py:410, _read_response) 2026-04-29 22:47:52 [ 539 ] DEBUG : Sending request(xid=141): GetData(path='/test_snapshot_multinode_recover138', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:52 [ 539 ] DEBUG : Received response(xid=141): (b'somedata138', ZnodeStat(czxid=174, mzxid=174, ctime=1777502851584, mtime=1777502851584, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=174)) (connection.py:410, _read_response) 2026-04-29 22:47:52 [ 539 ] DEBUG : Sending request(xid=142): GetData(path='/test_snapshot_multinode_recover139', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:52 [ 539 ] DEBUG : Received response(xid=142): (b'somedata139', ZnodeStat(czxid=175, mzxid=175, ctime=1777502851602, mtime=1777502851602, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=175)) (connection.py:410, _read_response) 2026-04-29 22:47:52 [ 539 ] DEBUG : Sending request(xid=142): GetData(path='/test_snapshot_multinode_recover139', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:52 [ 539 ] DEBUG : Received response(xid=142): (b'somedata139', ZnodeStat(czxid=175, mzxid=175, ctime=1777502851602, mtime=1777502851602, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=175)) (connection.py:410, _read_response) 2026-04-29 22:47:52 [ 539 ] DEBUG : Sending request(xid=142): GetData(path='/test_snapshot_multinode_recover139', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:52 [ 539 ] DEBUG : Received response(xid=142): (b'somedata139', ZnodeStat(czxid=175, mzxid=175, ctime=1777502851602, mtime=1777502851602, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=175)) (connection.py:410, _read_response) 2026-04-29 22:47:52 [ 539 ] DEBUG : Sending request(xid=143): Exists(path='/test_snapshot_multinode_recover140', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:52 [ 539 ] DEBUG : Sending request(xid=143): Exists(path='/test_snapshot_multinode_recover140', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:52 [ 539 ] DEBUG : Sending request(xid=143): Exists(path='/test_snapshot_multinode_recover140', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:52 [ 539 ] DEBUG : Sending request(xid=144): GetData(path='/test_snapshot_multinode_recover141', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:52 [ 539 ] DEBUG : Received response(xid=144): (b'somedata141', ZnodeStat(czxid=177, mzxid=177, ctime=1777502851644, mtime=1777502851644, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=177)) (connection.py:410, _read_response) 2026-04-29 22:47:52 [ 539 ] DEBUG : Sending request(xid=144): GetData(path='/test_snapshot_multinode_recover141', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:52 [ 539 ] DEBUG : Received response(xid=144): (b'somedata141', ZnodeStat(czxid=177, mzxid=177, ctime=1777502851644, mtime=1777502851644, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=177)) (connection.py:410, _read_response) 2026-04-29 22:47:52 [ 539 ] DEBUG : Sending request(xid=144): GetData(path='/test_snapshot_multinode_recover141', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:52 [ 539 ] DEBUG : Received response(xid=144): (b'somedata141', ZnodeStat(czxid=177, mzxid=177, ctime=1777502851644, mtime=1777502851644, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=177)) (connection.py:410, _read_response) 2026-04-29 22:47:52 [ 539 ] DEBUG : Sending request(xid=145): GetData(path='/test_snapshot_multinode_recover142', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:53 [ 539 ] DEBUG : Received response(xid=145): (b'somedata142', ZnodeStat(czxid=178, mzxid=178, ctime=1777502851666, mtime=1777502851666, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=178)) (connection.py:410, _read_response) 2026-04-29 22:47:53 [ 539 ] DEBUG : Sending request(xid=145): GetData(path='/test_snapshot_multinode_recover142', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:53 [ 539 ] DEBUG : Received response(xid=145): (b'somedata142', ZnodeStat(czxid=178, mzxid=178, ctime=1777502851666, mtime=1777502851666, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=178)) (connection.py:410, _read_response) 2026-04-29 22:47:53 [ 539 ] DEBUG : Sending request(xid=145): GetData(path='/test_snapshot_multinode_recover142', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:53 [ 539 ] DEBUG : Received response(xid=145): (b'somedata142', ZnodeStat(czxid=178, mzxid=178, ctime=1777502851666, mtime=1777502851666, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=178)) (connection.py:410, _read_response) 2026-04-29 22:47:53 [ 539 ] DEBUG : Sending request(xid=146): GetData(path='/test_snapshot_multinode_recover143', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:53 [ 539 ] DEBUG : Received response(xid=146): (b'somedata143', ZnodeStat(czxid=179, mzxid=179, ctime=1777502851686, mtime=1777502851686, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=179)) (connection.py:410, _read_response) 2026-04-29 22:47:53 [ 539 ] DEBUG : Sending request(xid=146): GetData(path='/test_snapshot_multinode_recover143', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:53 [ 539 ] DEBUG : Received response(xid=146): (b'somedata143', ZnodeStat(czxid=179, mzxid=179, ctime=1777502851686, mtime=1777502851686, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=179)) (connection.py:410, _read_response) 2026-04-29 22:47:53 [ 539 ] DEBUG : Sending request(xid=146): GetData(path='/test_snapshot_multinode_recover143', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:53 [ 539 ] DEBUG : Received response(xid=146): (b'somedata143', ZnodeStat(czxid=179, mzxid=179, ctime=1777502851686, mtime=1777502851686, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=179)) (connection.py:410, _read_response) 2026-04-29 22:47:53 [ 539 ] DEBUG : Sending request(xid=147): GetData(path='/test_snapshot_multinode_recover144', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:53 [ 539 ] DEBUG : Received response(xid=147): (b'somedata144', ZnodeStat(czxid=180, mzxid=180, ctime=1777502851724, mtime=1777502851724, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=180)) (connection.py:410, _read_response) 2026-04-29 22:47:53 [ 539 ] DEBUG : Sending request(xid=147): GetData(path='/test_snapshot_multinode_recover144', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:53 [ 539 ] DEBUG : Received response(xid=147): (b'somedata144', ZnodeStat(czxid=180, mzxid=180, ctime=1777502851724, mtime=1777502851724, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=180)) (connection.py:410, _read_response) 2026-04-29 22:47:53 [ 539 ] DEBUG : Sending request(xid=147): GetData(path='/test_snapshot_multinode_recover144', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:53 [ 539 ] DEBUG : Received response(xid=147): (b'somedata144', ZnodeStat(czxid=180, mzxid=180, ctime=1777502851724, mtime=1777502851724, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=180)) (connection.py:410, _read_response) 2026-04-29 22:47:53 [ 539 ] DEBUG : Sending request(xid=148): GetData(path='/test_snapshot_multinode_recover145', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:53 [ 539 ] DEBUG : Received response(xid=148): (b'somedata145', ZnodeStat(czxid=181, mzxid=181, ctime=1777502851744, mtime=1777502851744, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=181)) (connection.py:410, _read_response) 2026-04-29 22:47:53 [ 539 ] DEBUG : Sending request(xid=148): GetData(path='/test_snapshot_multinode_recover145', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:53 [ 539 ] DEBUG : Received response(xid=148): (b'somedata145', ZnodeStat(czxid=181, mzxid=181, ctime=1777502851744, mtime=1777502851744, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=181)) (connection.py:410, _read_response) 2026-04-29 22:47:53 [ 539 ] DEBUG : Sending request(xid=148): GetData(path='/test_snapshot_multinode_recover145', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:53 [ 539 ] DEBUG : Received response(xid=148): (b'somedata145', ZnodeStat(czxid=181, mzxid=181, ctime=1777502851744, mtime=1777502851744, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=181)) (connection.py:410, _read_response) 2026-04-29 22:47:53 [ 539 ] DEBUG : Sending request(xid=149): GetData(path='/test_snapshot_multinode_recover146', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:53 [ 539 ] DEBUG : Received response(xid=149): (b'somedata146', ZnodeStat(czxid=182, mzxid=182, ctime=1777502851756, mtime=1777502851756, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=182)) (connection.py:410, _read_response) 2026-04-29 22:47:53 [ 539 ] DEBUG : Sending request(xid=149): GetData(path='/test_snapshot_multinode_recover146', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:53 [ 539 ] DEBUG : Received response(xid=149): (b'somedata146', ZnodeStat(czxid=182, mzxid=182, ctime=1777502851756, mtime=1777502851756, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=182)) (connection.py:410, _read_response) 2026-04-29 22:47:53 [ 539 ] DEBUG : Sending request(xid=149): GetData(path='/test_snapshot_multinode_recover146', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:53 [ 539 ] DEBUG : Received response(xid=149): (b'somedata146', ZnodeStat(czxid=182, mzxid=182, ctime=1777502851756, mtime=1777502851756, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=182)) (connection.py:410, _read_response) 2026-04-29 22:47:53 [ 539 ] DEBUG : Sending request(xid=150): GetData(path='/test_snapshot_multinode_recover147', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:53 [ 539 ] DEBUG : Received response(xid=150): (b'somedata147', ZnodeStat(czxid=183, mzxid=183, ctime=1777502851778, mtime=1777502851778, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=183)) (connection.py:410, _read_response) 2026-04-29 22:47:53 [ 539 ] DEBUG : Sending request(xid=150): GetData(path='/test_snapshot_multinode_recover147', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:53 [ 539 ] DEBUG : Received response(xid=150): (b'somedata147', ZnodeStat(czxid=183, mzxid=183, ctime=1777502851778, mtime=1777502851778, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=183)) (connection.py:410, _read_response) 2026-04-29 22:47:53 [ 539 ] DEBUG : Sending request(xid=150): GetData(path='/test_snapshot_multinode_recover147', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:53 [ 539 ] DEBUG : Received response(xid=150): (b'somedata147', ZnodeStat(czxid=183, mzxid=183, ctime=1777502851778, mtime=1777502851778, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=183)) (connection.py:410, _read_response) 2026-04-29 22:47:53 [ 539 ] DEBUG : Sending request(xid=151): GetData(path='/test_snapshot_multinode_recover148', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:53 [ 539 ] DEBUG : Received response(xid=151): (b'somedata148', ZnodeStat(czxid=184, mzxid=184, ctime=1777502851800, mtime=1777502851800, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=184)) (connection.py:410, _read_response) 2026-04-29 22:47:53 [ 539 ] DEBUG : Sending request(xid=151): GetData(path='/test_snapshot_multinode_recover148', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:53 [ 539 ] DEBUG : Received response(xid=151): (b'somedata148', ZnodeStat(czxid=184, mzxid=184, ctime=1777502851800, mtime=1777502851800, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=184)) (connection.py:410, _read_response) 2026-04-29 22:47:53 [ 539 ] DEBUG : Sending request(xid=151): GetData(path='/test_snapshot_multinode_recover148', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:53 [ 539 ] DEBUG : Received response(xid=151): (b'somedata148', ZnodeStat(czxid=184, mzxid=184, ctime=1777502851800, mtime=1777502851800, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=184)) (connection.py:410, _read_response) 2026-04-29 22:47:53 [ 539 ] DEBUG : Sending request(xid=152): GetData(path='/test_snapshot_multinode_recover149', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:53 [ 539 ] DEBUG : Received response(xid=152): (b'somedata149', ZnodeStat(czxid=185, mzxid=185, ctime=1777502851824, mtime=1777502851824, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=185)) (connection.py:410, _read_response) 2026-04-29 22:47:53 [ 539 ] DEBUG : Sending request(xid=152): GetData(path='/test_snapshot_multinode_recover149', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:53 [ 539 ] DEBUG : Received response(xid=152): (b'somedata149', ZnodeStat(czxid=185, mzxid=185, ctime=1777502851824, mtime=1777502851824, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=185)) (connection.py:410, _read_response) 2026-04-29 22:47:53 [ 539 ] DEBUG : Sending request(xid=152): GetData(path='/test_snapshot_multinode_recover149', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:53 [ 539 ] DEBUG : Received response(xid=152): (b'somedata149', ZnodeStat(czxid=185, mzxid=185, ctime=1777502851824, mtime=1777502851824, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=185)) (connection.py:410, _read_response) 2026-04-29 22:47:53 [ 539 ] DEBUG : Sending request(xid=153): Exists(path='/test_snapshot_multinode_recover150', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:53 [ 539 ] DEBUG : Sending request(xid=153): Exists(path='/test_snapshot_multinode_recover150', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:53 [ 539 ] DEBUG : Sending request(xid=153): Exists(path='/test_snapshot_multinode_recover150', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:53 [ 539 ] DEBUG : Sending request(xid=154): GetData(path='/test_snapshot_multinode_recover151', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:53 [ 539 ] DEBUG : Received response(xid=154): (b'somedata151', ZnodeStat(czxid=187, mzxid=187, ctime=1777502851861, mtime=1777502851861, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=187)) (connection.py:410, _read_response) 2026-04-29 22:47:53 [ 539 ] DEBUG : Sending request(xid=154): GetData(path='/test_snapshot_multinode_recover151', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:53 [ 539 ] DEBUG : Received response(xid=154): (b'somedata151', ZnodeStat(czxid=187, mzxid=187, ctime=1777502851861, mtime=1777502851861, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=187)) (connection.py:410, _read_response) 2026-04-29 22:47:53 [ 539 ] DEBUG : Sending request(xid=154): GetData(path='/test_snapshot_multinode_recover151', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:53 [ 539 ] DEBUG : Received response(xid=154): (b'somedata151', ZnodeStat(czxid=187, mzxid=187, ctime=1777502851861, mtime=1777502851861, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=187)) (connection.py:410, _read_response) 2026-04-29 22:47:53 [ 539 ] DEBUG : Sending request(xid=155): GetData(path='/test_snapshot_multinode_recover152', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:53 [ 539 ] DEBUG : Received response(xid=155): (b'somedata152', ZnodeStat(czxid=188, mzxid=188, ctime=1777502851891, mtime=1777502851891, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=188)) (connection.py:410, _read_response) 2026-04-29 22:47:53 [ 539 ] DEBUG : Sending request(xid=155): GetData(path='/test_snapshot_multinode_recover152', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:53 [ 539 ] DEBUG : Received response(xid=155): (b'somedata152', ZnodeStat(czxid=188, mzxid=188, ctime=1777502851891, mtime=1777502851891, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=188)) (connection.py:410, _read_response) 2026-04-29 22:47:53 [ 539 ] DEBUG : Sending request(xid=155): GetData(path='/test_snapshot_multinode_recover152', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:53 [ 539 ] DEBUG : Received response(xid=155): (b'somedata152', ZnodeStat(czxid=188, mzxid=188, ctime=1777502851891, mtime=1777502851891, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=188)) (connection.py:410, _read_response) 2026-04-29 22:47:53 [ 539 ] DEBUG : Sending request(xid=156): GetData(path='/test_snapshot_multinode_recover153', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:53 [ 539 ] DEBUG : Received response(xid=156): (b'somedata153', ZnodeStat(czxid=189, mzxid=189, ctime=1777502851913, mtime=1777502851913, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=189)) (connection.py:410, _read_response) 2026-04-29 22:47:53 [ 539 ] DEBUG : Sending request(xid=156): GetData(path='/test_snapshot_multinode_recover153', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:53 [ 539 ] DEBUG : Received response(xid=156): (b'somedata153', ZnodeStat(czxid=189, mzxid=189, ctime=1777502851913, mtime=1777502851913, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=189)) (connection.py:410, _read_response) 2026-04-29 22:47:53 [ 539 ] DEBUG : Sending request(xid=156): GetData(path='/test_snapshot_multinode_recover153', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:53 [ 539 ] DEBUG : Received response(xid=156): (b'somedata153', ZnodeStat(czxid=189, mzxid=189, ctime=1777502851913, mtime=1777502851913, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=189)) (connection.py:410, _read_response) 2026-04-29 22:47:53 [ 539 ] DEBUG : Sending request(xid=157): GetData(path='/test_snapshot_multinode_recover154', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:53 [ 539 ] DEBUG : Received response(xid=157): (b'somedata154', ZnodeStat(czxid=190, mzxid=190, ctime=1777502851940, mtime=1777502851940, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=190)) (connection.py:410, _read_response) 2026-04-29 22:47:53 [ 539 ] DEBUG : Sending request(xid=157): GetData(path='/test_snapshot_multinode_recover154', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:53 [ 539 ] DEBUG : Received response(xid=157): (b'somedata154', ZnodeStat(czxid=190, mzxid=190, ctime=1777502851940, mtime=1777502851940, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=190)) (connection.py:410, _read_response) 2026-04-29 22:47:53 [ 539 ] DEBUG : Sending request(xid=157): GetData(path='/test_snapshot_multinode_recover154', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:53 [ 539 ] DEBUG : Received response(xid=157): (b'somedata154', ZnodeStat(czxid=190, mzxid=190, ctime=1777502851940, mtime=1777502851940, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=190)) (connection.py:410, _read_response) 2026-04-29 22:47:53 [ 539 ] DEBUG : Sending request(xid=158): GetData(path='/test_snapshot_multinode_recover155', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:53 [ 539 ] DEBUG : Received response(xid=158): (b'somedata155', ZnodeStat(czxid=191, mzxid=191, ctime=1777502851965, mtime=1777502851965, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=191)) (connection.py:410, _read_response) 2026-04-29 22:47:53 [ 539 ] DEBUG : Sending request(xid=158): GetData(path='/test_snapshot_multinode_recover155', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:53 [ 539 ] DEBUG : Received response(xid=158): (b'somedata155', ZnodeStat(czxid=191, mzxid=191, ctime=1777502851965, mtime=1777502851965, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=191)) (connection.py:410, _read_response) 2026-04-29 22:47:53 [ 539 ] DEBUG : Sending request(xid=158): GetData(path='/test_snapshot_multinode_recover155', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:53 [ 539 ] DEBUG : Received response(xid=158): (b'somedata155', ZnodeStat(czxid=191, mzxid=191, ctime=1777502851965, mtime=1777502851965, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=191)) (connection.py:410, _read_response) 2026-04-29 22:47:53 [ 539 ] DEBUG : Sending request(xid=159): GetData(path='/test_snapshot_multinode_recover156', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:53 [ 539 ] DEBUG : Received response(xid=159): (b'somedata156', ZnodeStat(czxid=192, mzxid=192, ctime=1777502851998, mtime=1777502851998, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=192)) (connection.py:410, _read_response) 2026-04-29 22:47:53 [ 539 ] DEBUG : Sending request(xid=159): GetData(path='/test_snapshot_multinode_recover156', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:53 [ 539 ] DEBUG : Received response(xid=159): (b'somedata156', ZnodeStat(czxid=192, mzxid=192, ctime=1777502851998, mtime=1777502851998, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=192)) (connection.py:410, _read_response) 2026-04-29 22:47:53 [ 539 ] DEBUG : Sending request(xid=159): GetData(path='/test_snapshot_multinode_recover156', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:53 [ 539 ] DEBUG : Received response(xid=159): (b'somedata156', ZnodeStat(czxid=192, mzxid=192, ctime=1777502851998, mtime=1777502851998, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=192)) (connection.py:410, _read_response) 2026-04-29 22:47:53 [ 539 ] DEBUG : Sending request(xid=160): GetData(path='/test_snapshot_multinode_recover157', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:53 [ 539 ] DEBUG : Received response(xid=160): (b'somedata157', ZnodeStat(czxid=193, mzxid=193, ctime=1777502852037, mtime=1777502852037, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=193)) (connection.py:410, _read_response) 2026-04-29 22:47:53 [ 539 ] DEBUG : Sending request(xid=160): GetData(path='/test_snapshot_multinode_recover157', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:53 [ 539 ] DEBUG : Received response(xid=160): (b'somedata157', ZnodeStat(czxid=193, mzxid=193, ctime=1777502852037, mtime=1777502852037, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=193)) (connection.py:410, _read_response) 2026-04-29 22:47:53 [ 539 ] DEBUG : Sending request(xid=160): GetData(path='/test_snapshot_multinode_recover157', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:53 [ 539 ] DEBUG : Received response(xid=160): (b'somedata157', ZnodeStat(czxid=193, mzxid=193, ctime=1777502852037, mtime=1777502852037, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=193)) (connection.py:410, _read_response) 2026-04-29 22:47:53 [ 539 ] DEBUG : Sending request(xid=161): GetData(path='/test_snapshot_multinode_recover158', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:53 [ 539 ] DEBUG : Received response(xid=161): (b'somedata158', ZnodeStat(czxid=194, mzxid=194, ctime=1777502852054, mtime=1777502852054, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=194)) (connection.py:410, _read_response) 2026-04-29 22:47:53 [ 539 ] DEBUG : Sending request(xid=161): GetData(path='/test_snapshot_multinode_recover158', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:53 [ 539 ] DEBUG : Received response(xid=161): (b'somedata158', ZnodeStat(czxid=194, mzxid=194, ctime=1777502852054, mtime=1777502852054, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=194)) (connection.py:410, _read_response) 2026-04-29 22:47:53 [ 539 ] DEBUG : Sending request(xid=161): GetData(path='/test_snapshot_multinode_recover158', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:53 [ 539 ] DEBUG : Received response(xid=161): (b'somedata158', ZnodeStat(czxid=194, mzxid=194, ctime=1777502852054, mtime=1777502852054, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=194)) (connection.py:410, _read_response) 2026-04-29 22:47:53 [ 539 ] DEBUG : Sending request(xid=162): GetData(path='/test_snapshot_multinode_recover159', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:53 [ 539 ] DEBUG : Received response(xid=162): (b'somedata159', ZnodeStat(czxid=195, mzxid=195, ctime=1777502852068, mtime=1777502852068, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=195)) (connection.py:410, _read_response) 2026-04-29 22:47:53 [ 539 ] DEBUG : Sending request(xid=162): GetData(path='/test_snapshot_multinode_recover159', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:53 [ 539 ] DEBUG : Received response(xid=162): (b'somedata159', ZnodeStat(czxid=195, mzxid=195, ctime=1777502852068, mtime=1777502852068, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=195)) (connection.py:410, _read_response) 2026-04-29 22:47:53 [ 539 ] DEBUG : Sending request(xid=162): GetData(path='/test_snapshot_multinode_recover159', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:53 [ 539 ] DEBUG : Received response(xid=162): (b'somedata159', ZnodeStat(czxid=195, mzxid=195, ctime=1777502852068, mtime=1777502852068, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=195)) (connection.py:410, _read_response) 2026-04-29 22:47:53 [ 539 ] DEBUG : Sending request(xid=163): Exists(path='/test_snapshot_multinode_recover160', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:53 [ 539 ] DEBUG : Sending request(xid=163): Exists(path='/test_snapshot_multinode_recover160', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:53 [ 539 ] DEBUG : Sending request(xid=163): Exists(path='/test_snapshot_multinode_recover160', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:53 [ 539 ] DEBUG : Sending request(xid=164): GetData(path='/test_snapshot_multinode_recover161', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:53 [ 539 ] DEBUG : Received response(xid=164): (b'somedata161', ZnodeStat(czxid=198, mzxid=198, ctime=1777502852101, mtime=1777502852101, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=198)) (connection.py:410, _read_response) 2026-04-29 22:47:53 [ 539 ] DEBUG : Sending request(xid=164): GetData(path='/test_snapshot_multinode_recover161', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:53 [ 539 ] DEBUG : Received response(xid=164): (b'somedata161', ZnodeStat(czxid=198, mzxid=198, ctime=1777502852101, mtime=1777502852101, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=198)) (connection.py:410, _read_response) 2026-04-29 22:47:53 [ 539 ] DEBUG : Sending request(xid=164): GetData(path='/test_snapshot_multinode_recover161', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:53 [ 539 ] DEBUG : Received response(xid=164): (b'somedata161', ZnodeStat(czxid=198, mzxid=198, ctime=1777502852101, mtime=1777502852101, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=198)) (connection.py:410, _read_response) 2026-04-29 22:47:53 [ 539 ] DEBUG : Sending request(xid=165): GetData(path='/test_snapshot_multinode_recover162', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:53 [ 539 ] DEBUG : Received response(xid=165): (b'somedata162', ZnodeStat(czxid=199, mzxid=199, ctime=1777502852122, mtime=1777502852122, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=199)) (connection.py:410, _read_response) 2026-04-29 22:47:53 [ 539 ] DEBUG : Sending request(xid=165): GetData(path='/test_snapshot_multinode_recover162', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:53 [ 539 ] DEBUG : Received response(xid=165): (b'somedata162', ZnodeStat(czxid=199, mzxid=199, ctime=1777502852122, mtime=1777502852122, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=199)) (connection.py:410, _read_response) 2026-04-29 22:47:53 [ 539 ] DEBUG : Sending request(xid=165): GetData(path='/test_snapshot_multinode_recover162', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:53 [ 539 ] DEBUG : Received response(xid=165): (b'somedata162', ZnodeStat(czxid=199, mzxid=199, ctime=1777502852122, mtime=1777502852122, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=199)) (connection.py:410, _read_response) 2026-04-29 22:47:53 [ 539 ] DEBUG : Sending request(xid=166): GetData(path='/test_snapshot_multinode_recover163', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:53 [ 539 ] DEBUG : Received response(xid=166): (b'somedata163', ZnodeStat(czxid=200, mzxid=200, ctime=1777502852141, mtime=1777502852141, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=200)) (connection.py:410, _read_response) 2026-04-29 22:47:53 [ 539 ] DEBUG : Sending request(xid=166): GetData(path='/test_snapshot_multinode_recover163', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:53 [ 539 ] DEBUG : Received response(xid=166): (b'somedata163', ZnodeStat(czxid=200, mzxid=200, ctime=1777502852141, mtime=1777502852141, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=200)) (connection.py:410, _read_response) 2026-04-29 22:47:53 [ 539 ] DEBUG : Sending request(xid=166): GetData(path='/test_snapshot_multinode_recover163', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:53 [ 539 ] DEBUG : Received response(xid=166): (b'somedata163', ZnodeStat(czxid=200, mzxid=200, ctime=1777502852141, mtime=1777502852141, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=200)) (connection.py:410, _read_response) 2026-04-29 22:47:53 [ 539 ] DEBUG : Sending request(xid=167): GetData(path='/test_snapshot_multinode_recover164', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:53 [ 539 ] DEBUG : Received response(xid=167): (b'somedata164', ZnodeStat(czxid=201, mzxid=201, ctime=1777502852167, mtime=1777502852167, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=201)) (connection.py:410, _read_response) 2026-04-29 22:47:53 [ 539 ] DEBUG : Sending request(xid=167): GetData(path='/test_snapshot_multinode_recover164', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:53 [ 539 ] DEBUG : Received response(xid=167): (b'somedata164', ZnodeStat(czxid=201, mzxid=201, ctime=1777502852167, mtime=1777502852167, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=201)) (connection.py:410, _read_response) 2026-04-29 22:47:53 [ 539 ] DEBUG : Sending request(xid=167): GetData(path='/test_snapshot_multinode_recover164', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:53 [ 539 ] DEBUG : Received response(xid=167): (b'somedata164', ZnodeStat(czxid=201, mzxid=201, ctime=1777502852167, mtime=1777502852167, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=201)) (connection.py:410, _read_response) 2026-04-29 22:47:53 [ 539 ] DEBUG : Sending request(xid=168): GetData(path='/test_snapshot_multinode_recover165', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:53 [ 539 ] DEBUG : Received response(xid=168): (b'somedata165', ZnodeStat(czxid=202, mzxid=202, ctime=1777502852192, mtime=1777502852192, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=202)) (connection.py:410, _read_response) 2026-04-29 22:47:53 [ 539 ] DEBUG : Sending request(xid=168): GetData(path='/test_snapshot_multinode_recover165', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:53 [ 539 ] DEBUG : Received response(xid=168): (b'somedata165', ZnodeStat(czxid=202, mzxid=202, ctime=1777502852192, mtime=1777502852192, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=202)) (connection.py:410, _read_response) 2026-04-29 22:47:53 [ 539 ] DEBUG : Sending request(xid=168): GetData(path='/test_snapshot_multinode_recover165', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:53 [ 539 ] DEBUG : Received response(xid=168): (b'somedata165', ZnodeStat(czxid=202, mzxid=202, ctime=1777502852192, mtime=1777502852192, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=202)) (connection.py:410, _read_response) 2026-04-29 22:47:53 [ 539 ] DEBUG : Sending request(xid=169): GetData(path='/test_snapshot_multinode_recover166', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:53 [ 539 ] DEBUG : Received response(xid=169): (b'somedata166', ZnodeStat(czxid=203, mzxid=203, ctime=1777502852239, mtime=1777502852239, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=203)) (connection.py:410, _read_response) 2026-04-29 22:47:53 [ 539 ] DEBUG : Sending request(xid=169): GetData(path='/test_snapshot_multinode_recover166', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:53 [ 539 ] DEBUG : Received response(xid=169): (b'somedata166', ZnodeStat(czxid=203, mzxid=203, ctime=1777502852239, mtime=1777502852239, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=203)) (connection.py:410, _read_response) 2026-04-29 22:47:53 [ 539 ] DEBUG : Sending request(xid=169): GetData(path='/test_snapshot_multinode_recover166', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:53 [ 539 ] DEBUG : Received response(xid=169): (b'somedata166', ZnodeStat(czxid=203, mzxid=203, ctime=1777502852239, mtime=1777502852239, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=203)) (connection.py:410, _read_response) 2026-04-29 22:47:53 [ 539 ] DEBUG : Sending request(xid=170): GetData(path='/test_snapshot_multinode_recover167', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:53 [ 539 ] DEBUG : Received response(xid=170): (b'somedata167', ZnodeStat(czxid=204, mzxid=204, ctime=1777502852255, mtime=1777502852255, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=204)) (connection.py:410, _read_response) 2026-04-29 22:47:53 [ 539 ] DEBUG : Sending request(xid=170): GetData(path='/test_snapshot_multinode_recover167', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:53 [ 539 ] DEBUG : Received response(xid=170): (b'somedata167', ZnodeStat(czxid=204, mzxid=204, ctime=1777502852255, mtime=1777502852255, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=204)) (connection.py:410, _read_response) 2026-04-29 22:47:53 [ 539 ] DEBUG : Sending request(xid=170): GetData(path='/test_snapshot_multinode_recover167', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:53 [ 539 ] DEBUG : Received response(xid=170): (b'somedata167', ZnodeStat(czxid=204, mzxid=204, ctime=1777502852255, mtime=1777502852255, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=204)) (connection.py:410, _read_response) 2026-04-29 22:47:53 [ 539 ] DEBUG : Sending request(xid=171): GetData(path='/test_snapshot_multinode_recover168', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:53 [ 539 ] DEBUG : Received response(xid=171): (b'somedata168', ZnodeStat(czxid=205, mzxid=205, ctime=1777502852269, mtime=1777502852269, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=205)) (connection.py:410, _read_response) 2026-04-29 22:47:53 [ 539 ] DEBUG : Sending request(xid=171): GetData(path='/test_snapshot_multinode_recover168', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:53 [ 539 ] DEBUG : Received response(xid=171): (b'somedata168', ZnodeStat(czxid=205, mzxid=205, ctime=1777502852269, mtime=1777502852269, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=205)) (connection.py:410, _read_response) 2026-04-29 22:47:53 [ 539 ] DEBUG : Sending request(xid=171): GetData(path='/test_snapshot_multinode_recover168', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:53 [ 539 ] DEBUG : Received response(xid=171): (b'somedata168', ZnodeStat(czxid=205, mzxid=205, ctime=1777502852269, mtime=1777502852269, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=205)) (connection.py:410, _read_response) 2026-04-29 22:47:53 [ 539 ] DEBUG : Sending request(xid=172): GetData(path='/test_snapshot_multinode_recover169', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:53 [ 539 ] DEBUG : Received response(xid=172): (b'somedata169', ZnodeStat(czxid=206, mzxid=206, ctime=1777502852304, mtime=1777502852304, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=206)) (connection.py:410, _read_response) 2026-04-29 22:47:53 [ 539 ] DEBUG : Sending request(xid=172): GetData(path='/test_snapshot_multinode_recover169', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:53 [ 539 ] DEBUG : Received response(xid=172): (b'somedata169', ZnodeStat(czxid=206, mzxid=206, ctime=1777502852304, mtime=1777502852304, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=206)) (connection.py:410, _read_response) 2026-04-29 22:47:53 [ 539 ] DEBUG : Sending request(xid=172): GetData(path='/test_snapshot_multinode_recover169', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:53 [ 539 ] DEBUG : Received response(xid=172): (b'somedata169', ZnodeStat(czxid=206, mzxid=206, ctime=1777502852304, mtime=1777502852304, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=206)) (connection.py:410, _read_response) 2026-04-29 22:47:53 [ 539 ] DEBUG : Sending request(xid=173): Exists(path='/test_snapshot_multinode_recover170', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:53 [ 539 ] DEBUG : Sending request(xid=173): Exists(path='/test_snapshot_multinode_recover170', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:53 [ 539 ] DEBUG : Sending request(xid=173): Exists(path='/test_snapshot_multinode_recover170', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:53 [ 539 ] DEBUG : Sending request(xid=174): GetData(path='/test_snapshot_multinode_recover171', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:53 [ 539 ] DEBUG : Received response(xid=174): (b'somedata171', ZnodeStat(czxid=208, mzxid=208, ctime=1777502852337, mtime=1777502852337, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=208)) (connection.py:410, _read_response) 2026-04-29 22:47:53 [ 539 ] DEBUG : Sending request(xid=174): GetData(path='/test_snapshot_multinode_recover171', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:53 [ 539 ] DEBUG : Received response(xid=174): (b'somedata171', ZnodeStat(czxid=208, mzxid=208, ctime=1777502852337, mtime=1777502852337, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=208)) (connection.py:410, _read_response) 2026-04-29 22:47:53 [ 539 ] DEBUG : Sending request(xid=174): GetData(path='/test_snapshot_multinode_recover171', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:53 [ 539 ] DEBUG : Received response(xid=174): (b'somedata171', ZnodeStat(czxid=208, mzxid=208, ctime=1777502852337, mtime=1777502852337, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=208)) (connection.py:410, _read_response) 2026-04-29 22:47:53 [ 539 ] DEBUG : Sending request(xid=175): GetData(path='/test_snapshot_multinode_recover172', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:53 [ 539 ] DEBUG : Received response(xid=175): (b'somedata172', ZnodeStat(czxid=209, mzxid=209, ctime=1777502852377, mtime=1777502852377, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=209)) (connection.py:410, _read_response) 2026-04-29 22:47:53 [ 539 ] DEBUG : Sending request(xid=175): GetData(path='/test_snapshot_multinode_recover172', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:53 [ 539 ] DEBUG : Received response(xid=175): (b'somedata172', ZnodeStat(czxid=209, mzxid=209, ctime=1777502852377, mtime=1777502852377, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=209)) (connection.py:410, _read_response) 2026-04-29 22:47:53 [ 539 ] DEBUG : Sending request(xid=175): GetData(path='/test_snapshot_multinode_recover172', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:53 [ 539 ] DEBUG : Received response(xid=175): (b'somedata172', ZnodeStat(czxid=209, mzxid=209, ctime=1777502852377, mtime=1777502852377, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=209)) (connection.py:410, _read_response) 2026-04-29 22:47:53 [ 539 ] DEBUG : Sending request(xid=176): GetData(path='/test_snapshot_multinode_recover173', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:53 [ 539 ] DEBUG : Received response(xid=176): (b'somedata173', ZnodeStat(czxid=210, mzxid=210, ctime=1777502852397, mtime=1777502852397, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=210)) (connection.py:410, _read_response) 2026-04-29 22:47:53 [ 539 ] DEBUG : Sending request(xid=176): GetData(path='/test_snapshot_multinode_recover173', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:53 [ 539 ] DEBUG : Received response(xid=176): (b'somedata173', ZnodeStat(czxid=210, mzxid=210, ctime=1777502852397, mtime=1777502852397, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=210)) (connection.py:410, _read_response) 2026-04-29 22:47:54 [ 539 ] DEBUG : Sending request(xid=176): GetData(path='/test_snapshot_multinode_recover173', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:54 [ 539 ] DEBUG : Received response(xid=176): (b'somedata173', ZnodeStat(czxid=210, mzxid=210, ctime=1777502852397, mtime=1777502852397, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=210)) (connection.py:410, _read_response) 2026-04-29 22:47:54 [ 539 ] DEBUG : Sending request(xid=177): GetData(path='/test_snapshot_multinode_recover174', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:54 [ 539 ] DEBUG : Received response(xid=177): (b'somedata174', ZnodeStat(czxid=211, mzxid=211, ctime=1777502852428, mtime=1777502852428, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=211)) (connection.py:410, _read_response) 2026-04-29 22:47:54 [ 539 ] DEBUG : Sending request(xid=177): GetData(path='/test_snapshot_multinode_recover174', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:54 [ 539 ] DEBUG : Received response(xid=177): (b'somedata174', ZnodeStat(czxid=211, mzxid=211, ctime=1777502852428, mtime=1777502852428, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=211)) (connection.py:410, _read_response) 2026-04-29 22:47:54 [ 539 ] DEBUG : Sending request(xid=177): GetData(path='/test_snapshot_multinode_recover174', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:54 [ 539 ] DEBUG : Received response(xid=177): (b'somedata174', ZnodeStat(czxid=211, mzxid=211, ctime=1777502852428, mtime=1777502852428, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=211)) (connection.py:410, _read_response) 2026-04-29 22:47:54 [ 539 ] DEBUG : Sending request(xid=178): GetData(path='/test_snapshot_multinode_recover175', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:54 [ 539 ] DEBUG : Received response(xid=178): (b'somedata175', ZnodeStat(czxid=212, mzxid=212, ctime=1777502852448, mtime=1777502852448, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=212)) (connection.py:410, _read_response) 2026-04-29 22:47:54 [ 539 ] DEBUG : Sending request(xid=178): GetData(path='/test_snapshot_multinode_recover175', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:54 [ 539 ] DEBUG : Received response(xid=178): (b'somedata175', ZnodeStat(czxid=212, mzxid=212, ctime=1777502852448, mtime=1777502852448, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=212)) (connection.py:410, _read_response) 2026-04-29 22:47:54 [ 539 ] DEBUG : Sending request(xid=178): GetData(path='/test_snapshot_multinode_recover175', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:54 [ 539 ] DEBUG : Received response(xid=178): (b'somedata175', ZnodeStat(czxid=212, mzxid=212, ctime=1777502852448, mtime=1777502852448, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=212)) (connection.py:410, _read_response) 2026-04-29 22:47:54 [ 539 ] DEBUG : Sending request(xid=179): GetData(path='/test_snapshot_multinode_recover176', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:54 [ 539 ] DEBUG : Received response(xid=179): (b'somedata176', ZnodeStat(czxid=213, mzxid=213, ctime=1777502852479, mtime=1777502852479, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=213)) (connection.py:410, _read_response) 2026-04-29 22:47:54 [ 539 ] DEBUG : Sending request(xid=179): GetData(path='/test_snapshot_multinode_recover176', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:54 [ 539 ] DEBUG : Received response(xid=179): (b'somedata176', ZnodeStat(czxid=213, mzxid=213, ctime=1777502852479, mtime=1777502852479, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=213)) (connection.py:410, _read_response) 2026-04-29 22:47:54 [ 539 ] DEBUG : Sending request(xid=179): GetData(path='/test_snapshot_multinode_recover176', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:54 [ 539 ] DEBUG : Received response(xid=179): (b'somedata176', ZnodeStat(czxid=213, mzxid=213, ctime=1777502852479, mtime=1777502852479, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=213)) (connection.py:410, _read_response) 2026-04-29 22:47:54 [ 539 ] DEBUG : Sending request(xid=180): GetData(path='/test_snapshot_multinode_recover177', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:54 [ 539 ] DEBUG : Received response(xid=180): (b'somedata177', ZnodeStat(czxid=214, mzxid=214, ctime=1777502852496, mtime=1777502852496, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=214)) (connection.py:410, _read_response) 2026-04-29 22:47:54 [ 539 ] DEBUG : Sending request(xid=180): GetData(path='/test_snapshot_multinode_recover177', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:54 [ 539 ] DEBUG : Received response(xid=180): (b'somedata177', ZnodeStat(czxid=214, mzxid=214, ctime=1777502852496, mtime=1777502852496, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=214)) (connection.py:410, _read_response) 2026-04-29 22:47:54 [ 539 ] DEBUG : Sending request(xid=180): GetData(path='/test_snapshot_multinode_recover177', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:54 [ 539 ] DEBUG : Received response(xid=180): (b'somedata177', ZnodeStat(czxid=214, mzxid=214, ctime=1777502852496, mtime=1777502852496, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=214)) (connection.py:410, _read_response) 2026-04-29 22:47:54 [ 539 ] DEBUG : Sending request(xid=181): GetData(path='/test_snapshot_multinode_recover178', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:54 [ 539 ] DEBUG : Received response(xid=181): (b'somedata178', ZnodeStat(czxid=215, mzxid=215, ctime=1777502852525, mtime=1777502852525, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=215)) (connection.py:410, _read_response) 2026-04-29 22:47:54 [ 539 ] DEBUG : Sending request(xid=181): GetData(path='/test_snapshot_multinode_recover178', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:54 [ 539 ] DEBUG : Received response(xid=181): (b'somedata178', ZnodeStat(czxid=215, mzxid=215, ctime=1777502852525, mtime=1777502852525, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=215)) (connection.py:410, _read_response) 2026-04-29 22:47:54 [ 539 ] DEBUG : Sending request(xid=181): GetData(path='/test_snapshot_multinode_recover178', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:54 [ 539 ] DEBUG : Received response(xid=181): (b'somedata178', ZnodeStat(czxid=215, mzxid=215, ctime=1777502852525, mtime=1777502852525, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=215)) (connection.py:410, _read_response) 2026-04-29 22:47:54 [ 539 ] DEBUG : Sending request(xid=182): GetData(path='/test_snapshot_multinode_recover179', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:54 [ 539 ] DEBUG : Received response(xid=182): (b'somedata179', ZnodeStat(czxid=216, mzxid=216, ctime=1777502852554, mtime=1777502852554, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=216)) (connection.py:410, _read_response) 2026-04-29 22:47:54 [ 539 ] DEBUG : Sending request(xid=182): GetData(path='/test_snapshot_multinode_recover179', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:54 [ 539 ] DEBUG : Received response(xid=182): (b'somedata179', ZnodeStat(czxid=216, mzxid=216, ctime=1777502852554, mtime=1777502852554, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=216)) (connection.py:410, _read_response) 2026-04-29 22:47:54 [ 539 ] DEBUG : Sending request(xid=182): GetData(path='/test_snapshot_multinode_recover179', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:54 [ 539 ] DEBUG : Received response(xid=182): (b'somedata179', ZnodeStat(czxid=216, mzxid=216, ctime=1777502852554, mtime=1777502852554, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=216)) (connection.py:410, _read_response) 2026-04-29 22:47:54 [ 539 ] DEBUG : Sending request(xid=183): Exists(path='/test_snapshot_multinode_recover180', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:54 [ 539 ] DEBUG : Sending request(xid=183): Exists(path='/test_snapshot_multinode_recover180', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:54 [ 539 ] DEBUG : Sending request(xid=183): Exists(path='/test_snapshot_multinode_recover180', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:54 [ 539 ] DEBUG : Sending request(xid=184): GetData(path='/test_snapshot_multinode_recover181', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:54 [ 539 ] DEBUG : Received response(xid=184): (b'somedata181', ZnodeStat(czxid=218, mzxid=218, ctime=1777502852619, mtime=1777502852619, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=218)) (connection.py:410, _read_response) 2026-04-29 22:47:54 [ 539 ] DEBUG : Sending request(xid=184): GetData(path='/test_snapshot_multinode_recover181', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:54 [ 539 ] DEBUG : Received response(xid=184): (b'somedata181', ZnodeStat(czxid=218, mzxid=218, ctime=1777502852619, mtime=1777502852619, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=218)) (connection.py:410, _read_response) 2026-04-29 22:47:54 [ 539 ] DEBUG : Sending request(xid=184): GetData(path='/test_snapshot_multinode_recover181', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:54 [ 539 ] DEBUG : Received response(xid=184): (b'somedata181', ZnodeStat(czxid=218, mzxid=218, ctime=1777502852619, mtime=1777502852619, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=218)) (connection.py:410, _read_response) 2026-04-29 22:47:54 [ 539 ] DEBUG : Sending request(xid=185): GetData(path='/test_snapshot_multinode_recover182', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:54 [ 539 ] DEBUG : Received response(xid=185): (b'somedata182', ZnodeStat(czxid=220, mzxid=220, ctime=1777502852642, mtime=1777502852642, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=220)) (connection.py:410, _read_response) 2026-04-29 22:47:54 [ 539 ] DEBUG : Sending request(xid=185): GetData(path='/test_snapshot_multinode_recover182', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:54 [ 539 ] DEBUG : Received response(xid=185): (b'somedata182', ZnodeStat(czxid=220, mzxid=220, ctime=1777502852642, mtime=1777502852642, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=220)) (connection.py:410, _read_response) 2026-04-29 22:47:54 [ 539 ] DEBUG : Sending request(xid=185): GetData(path='/test_snapshot_multinode_recover182', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:54 [ 539 ] DEBUG : Received response(xid=185): (b'somedata182', ZnodeStat(czxid=220, mzxid=220, ctime=1777502852642, mtime=1777502852642, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=220)) (connection.py:410, _read_response) 2026-04-29 22:47:54 [ 539 ] DEBUG : Sending request(xid=186): GetData(path='/test_snapshot_multinode_recover183', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:54 [ 539 ] DEBUG : Received response(xid=186): (b'somedata183', ZnodeStat(czxid=221, mzxid=221, ctime=1777502852687, mtime=1777502852687, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=221)) (connection.py:410, _read_response) 2026-04-29 22:47:54 [ 539 ] DEBUG : Sending request(xid=186): GetData(path='/test_snapshot_multinode_recover183', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:54 [ 539 ] DEBUG : Received response(xid=186): (b'somedata183', ZnodeStat(czxid=221, mzxid=221, ctime=1777502852687, mtime=1777502852687, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=221)) (connection.py:410, _read_response) 2026-04-29 22:47:54 [ 539 ] DEBUG : Sending request(xid=186): GetData(path='/test_snapshot_multinode_recover183', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:54 [ 539 ] DEBUG : Received response(xid=186): (b'somedata183', ZnodeStat(czxid=221, mzxid=221, ctime=1777502852687, mtime=1777502852687, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=221)) (connection.py:410, _read_response) 2026-04-29 22:47:54 [ 539 ] DEBUG : Sending request(xid=187): GetData(path='/test_snapshot_multinode_recover184', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:54 [ 539 ] DEBUG : Received response(xid=187): (b'somedata184', ZnodeStat(czxid=222, mzxid=222, ctime=1777502852742, mtime=1777502852742, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=222)) (connection.py:410, _read_response) 2026-04-29 22:47:54 [ 539 ] DEBUG : Sending request(xid=187): GetData(path='/test_snapshot_multinode_recover184', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:54 [ 539 ] DEBUG : Received response(xid=187): (b'somedata184', ZnodeStat(czxid=222, mzxid=222, ctime=1777502852742, mtime=1777502852742, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=222)) (connection.py:410, _read_response) 2026-04-29 22:47:54 [ 539 ] DEBUG : Sending request(xid=187): GetData(path='/test_snapshot_multinode_recover184', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:54 [ 539 ] DEBUG : Received response(xid=187): (b'somedata184', ZnodeStat(czxid=222, mzxid=222, ctime=1777502852742, mtime=1777502852742, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=222)) (connection.py:410, _read_response) 2026-04-29 22:47:54 [ 539 ] DEBUG : Sending request(xid=188): GetData(path='/test_snapshot_multinode_recover185', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:54 [ 539 ] DEBUG : Received response(xid=188): (b'somedata185', ZnodeStat(czxid=223, mzxid=223, ctime=1777502852784, mtime=1777502852784, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=223)) (connection.py:410, _read_response) 2026-04-29 22:47:54 [ 539 ] DEBUG : Sending request(xid=188): GetData(path='/test_snapshot_multinode_recover185', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:54 [ 539 ] DEBUG : Received response(xid=188): (b'somedata185', ZnodeStat(czxid=223, mzxid=223, ctime=1777502852784, mtime=1777502852784, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=223)) (connection.py:410, _read_response) 2026-04-29 22:47:54 [ 539 ] DEBUG : Sending request(xid=188): GetData(path='/test_snapshot_multinode_recover185', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:54 [ 539 ] DEBUG : Received response(xid=188): (b'somedata185', ZnodeStat(czxid=223, mzxid=223, ctime=1777502852784, mtime=1777502852784, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=223)) (connection.py:410, _read_response) 2026-04-29 22:47:54 [ 539 ] DEBUG : Sending request(xid=189): GetData(path='/test_snapshot_multinode_recover186', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:54 [ 539 ] DEBUG : Received response(xid=189): (b'somedata186', ZnodeStat(czxid=224, mzxid=224, ctime=1777502852842, mtime=1777502852842, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=224)) (connection.py:410, _read_response) 2026-04-29 22:47:54 [ 539 ] DEBUG : Sending request(xid=189): GetData(path='/test_snapshot_multinode_recover186', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:54 [ 539 ] DEBUG : Received response(xid=189): (b'somedata186', ZnodeStat(czxid=224, mzxid=224, ctime=1777502852842, mtime=1777502852842, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=224)) (connection.py:410, _read_response) 2026-04-29 22:47:54 [ 539 ] DEBUG : Sending request(xid=189): GetData(path='/test_snapshot_multinode_recover186', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:54 [ 539 ] DEBUG : Received response(xid=189): (b'somedata186', ZnodeStat(czxid=224, mzxid=224, ctime=1777502852842, mtime=1777502852842, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=224)) (connection.py:410, _read_response) 2026-04-29 22:47:54 [ 539 ] DEBUG : Sending request(xid=190): GetData(path='/test_snapshot_multinode_recover187', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:54 [ 539 ] DEBUG : Received response(xid=190): (b'somedata187', ZnodeStat(czxid=225, mzxid=225, ctime=1777502852869, mtime=1777502852869, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=225)) (connection.py:410, _read_response) 2026-04-29 22:47:54 [ 539 ] DEBUG : Sending request(xid=190): GetData(path='/test_snapshot_multinode_recover187', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:54 [ 539 ] DEBUG : Received response(xid=190): (b'somedata187', ZnodeStat(czxid=225, mzxid=225, ctime=1777502852869, mtime=1777502852869, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=225)) (connection.py:410, _read_response) 2026-04-29 22:47:54 [ 539 ] DEBUG : Sending request(xid=190): GetData(path='/test_snapshot_multinode_recover187', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:54 [ 539 ] DEBUG : Received response(xid=190): (b'somedata187', ZnodeStat(czxid=225, mzxid=225, ctime=1777502852869, mtime=1777502852869, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=225)) (connection.py:410, _read_response) 2026-04-29 22:47:54 [ 539 ] DEBUG : Sending request(xid=191): GetData(path='/test_snapshot_multinode_recover188', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:54 [ 539 ] DEBUG : Received response(xid=191): (b'somedata188', ZnodeStat(czxid=226, mzxid=226, ctime=1777502852934, mtime=1777502852934, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=226)) (connection.py:410, _read_response) 2026-04-29 22:47:54 [ 539 ] DEBUG : Sending request(xid=191): GetData(path='/test_snapshot_multinode_recover188', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:54 [ 539 ] DEBUG : Received response(xid=191): (b'somedata188', ZnodeStat(czxid=226, mzxid=226, ctime=1777502852934, mtime=1777502852934, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=226)) (connection.py:410, _read_response) 2026-04-29 22:47:54 [ 539 ] DEBUG : Sending request(xid=191): GetData(path='/test_snapshot_multinode_recover188', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:54 [ 539 ] DEBUG : Received response(xid=191): (b'somedata188', ZnodeStat(czxid=226, mzxid=226, ctime=1777502852934, mtime=1777502852934, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=226)) (connection.py:410, _read_response) 2026-04-29 22:47:54 [ 539 ] DEBUG : Sending request(xid=192): GetData(path='/test_snapshot_multinode_recover189', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:54 [ 539 ] DEBUG : Received response(xid=192): (b'somedata189', ZnodeStat(czxid=228, mzxid=228, ctime=1777502852983, mtime=1777502852983, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=228)) (connection.py:410, _read_response) 2026-04-29 22:47:54 [ 539 ] DEBUG : Sending request(xid=192): GetData(path='/test_snapshot_multinode_recover189', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:54 [ 539 ] DEBUG : Received response(xid=192): (b'somedata189', ZnodeStat(czxid=228, mzxid=228, ctime=1777502852983, mtime=1777502852983, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=228)) (connection.py:410, _read_response) 2026-04-29 22:47:54 [ 539 ] DEBUG : Sending request(xid=192): GetData(path='/test_snapshot_multinode_recover189', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:54 [ 539 ] DEBUG : Received response(xid=192): (b'somedata189', ZnodeStat(czxid=228, mzxid=228, ctime=1777502852983, mtime=1777502852983, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=228)) (connection.py:410, _read_response) 2026-04-29 22:47:54 [ 539 ] DEBUG : Sending request(xid=193): Exists(path='/test_snapshot_multinode_recover190', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:54 [ 539 ] DEBUG : Sending request(xid=193): Exists(path='/test_snapshot_multinode_recover190', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:54 [ 539 ] DEBUG : Sending request(xid=193): Exists(path='/test_snapshot_multinode_recover190', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:54 [ 539 ] DEBUG : Sending request(xid=194): GetData(path='/test_snapshot_multinode_recover191', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:54 [ 539 ] DEBUG : Received response(xid=194): (b'somedata191', ZnodeStat(czxid=230, mzxid=230, ctime=1777502853046, mtime=1777502853046, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=230)) (connection.py:410, _read_response) 2026-04-29 22:47:54 [ 539 ] DEBUG : Sending request(xid=194): GetData(path='/test_snapshot_multinode_recover191', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:54 [ 539 ] DEBUG : Received response(xid=194): (b'somedata191', ZnodeStat(czxid=230, mzxid=230, ctime=1777502853046, mtime=1777502853046, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=230)) (connection.py:410, _read_response) 2026-04-29 22:47:54 [ 539 ] DEBUG : Sending request(xid=194): GetData(path='/test_snapshot_multinode_recover191', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:54 [ 539 ] DEBUG : Received response(xid=194): (b'somedata191', ZnodeStat(czxid=230, mzxid=230, ctime=1777502853046, mtime=1777502853046, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=230)) (connection.py:410, _read_response) 2026-04-29 22:47:54 [ 539 ] DEBUG : Sending request(xid=195): GetData(path='/test_snapshot_multinode_recover192', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:54 [ 539 ] DEBUG : Received response(xid=195): (b'somedata192', ZnodeStat(czxid=231, mzxid=231, ctime=1777502853064, mtime=1777502853064, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=231)) (connection.py:410, _read_response) 2026-04-29 22:47:54 [ 539 ] DEBUG : Sending request(xid=195): GetData(path='/test_snapshot_multinode_recover192', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:54 [ 539 ] DEBUG : Received response(xid=195): (b'somedata192', ZnodeStat(czxid=231, mzxid=231, ctime=1777502853064, mtime=1777502853064, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=231)) (connection.py:410, _read_response) 2026-04-29 22:47:54 [ 539 ] DEBUG : Sending request(xid=195): GetData(path='/test_snapshot_multinode_recover192', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:54 [ 539 ] DEBUG : Received response(xid=195): (b'somedata192', ZnodeStat(czxid=231, mzxid=231, ctime=1777502853064, mtime=1777502853064, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=231)) (connection.py:410, _read_response) 2026-04-29 22:47:54 [ 539 ] DEBUG : Sending request(xid=196): GetData(path='/test_snapshot_multinode_recover193', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:54 [ 539 ] DEBUG : Received response(xid=196): (b'somedata193', ZnodeStat(czxid=232, mzxid=232, ctime=1777502853096, mtime=1777502853096, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=232)) (connection.py:410, _read_response) 2026-04-29 22:47:54 [ 539 ] DEBUG : Sending request(xid=196): GetData(path='/test_snapshot_multinode_recover193', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:54 [ 539 ] DEBUG : Received response(xid=196): (b'somedata193', ZnodeStat(czxid=232, mzxid=232, ctime=1777502853096, mtime=1777502853096, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=232)) (connection.py:410, _read_response) 2026-04-29 22:47:54 [ 539 ] DEBUG : Sending request(xid=196): GetData(path='/test_snapshot_multinode_recover193', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:54 [ 539 ] DEBUG : Received response(xid=196): (b'somedata193', ZnodeStat(czxid=232, mzxid=232, ctime=1777502853096, mtime=1777502853096, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=232)) (connection.py:410, _read_response) 2026-04-29 22:47:54 [ 539 ] DEBUG : Sending request(xid=197): GetData(path='/test_snapshot_multinode_recover194', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:54 [ 539 ] DEBUG : Received response(xid=197): (b'somedata194', ZnodeStat(czxid=233, mzxid=233, ctime=1777502853160, mtime=1777502853160, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=233)) (connection.py:410, _read_response) 2026-04-29 22:47:54 [ 539 ] DEBUG : Sending request(xid=197): GetData(path='/test_snapshot_multinode_recover194', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:54 [ 539 ] DEBUG : Received response(xid=197): (b'somedata194', ZnodeStat(czxid=233, mzxid=233, ctime=1777502853160, mtime=1777502853160, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=233)) (connection.py:410, _read_response) 2026-04-29 22:47:54 [ 539 ] DEBUG : Sending request(xid=197): GetData(path='/test_snapshot_multinode_recover194', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:54 [ 539 ] DEBUG : Received response(xid=197): (b'somedata194', ZnodeStat(czxid=233, mzxid=233, ctime=1777502853160, mtime=1777502853160, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=233)) (connection.py:410, _read_response) 2026-04-29 22:47:54 [ 539 ] DEBUG : Sending request(xid=198): GetData(path='/test_snapshot_multinode_recover195', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:54 [ 539 ] DEBUG : Received response(xid=198): (b'somedata195', ZnodeStat(czxid=234, mzxid=234, ctime=1777502853183, mtime=1777502853183, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=234)) (connection.py:410, _read_response) 2026-04-29 22:47:54 [ 539 ] DEBUG : Sending request(xid=198): GetData(path='/test_snapshot_multinode_recover195', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:54 [ 539 ] DEBUG : Received response(xid=198): (b'somedata195', ZnodeStat(czxid=234, mzxid=234, ctime=1777502853183, mtime=1777502853183, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=234)) (connection.py:410, _read_response) 2026-04-29 22:47:54 [ 539 ] DEBUG : Sending request(xid=198): GetData(path='/test_snapshot_multinode_recover195', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:54 [ 539 ] DEBUG : Received response(xid=198): (b'somedata195', ZnodeStat(czxid=234, mzxid=234, ctime=1777502853183, mtime=1777502853183, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=234)) (connection.py:410, _read_response) 2026-04-29 22:47:54 [ 539 ] DEBUG : Sending request(xid=199): GetData(path='/test_snapshot_multinode_recover196', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:54 [ 539 ] DEBUG : Received response(xid=199): (b'somedata196', ZnodeStat(czxid=235, mzxid=235, ctime=1777502853213, mtime=1777502853213, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=235)) (connection.py:410, _read_response) 2026-04-29 22:47:54 [ 539 ] DEBUG : Sending request(xid=199): GetData(path='/test_snapshot_multinode_recover196', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:54 [ 539 ] DEBUG : Received response(xid=199): (b'somedata196', ZnodeStat(czxid=235, mzxid=235, ctime=1777502853213, mtime=1777502853213, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=235)) (connection.py:410, _read_response) 2026-04-29 22:47:54 [ 539 ] DEBUG : Sending request(xid=199): GetData(path='/test_snapshot_multinode_recover196', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:54 [ 539 ] DEBUG : Received response(xid=199): (b'somedata196', ZnodeStat(czxid=235, mzxid=235, ctime=1777502853213, mtime=1777502853213, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=235)) (connection.py:410, _read_response) 2026-04-29 22:47:54 [ 539 ] DEBUG : Sending request(xid=200): GetData(path='/test_snapshot_multinode_recover197', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:54 [ 539 ] DEBUG : Received response(xid=200): (b'somedata197', ZnodeStat(czxid=236, mzxid=236, ctime=1777502853239, mtime=1777502853239, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=236)) (connection.py:410, _read_response) 2026-04-29 22:47:54 [ 539 ] DEBUG : Sending request(xid=200): GetData(path='/test_snapshot_multinode_recover197', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:54 [ 539 ] DEBUG : Received response(xid=200): (b'somedata197', ZnodeStat(czxid=236, mzxid=236, ctime=1777502853239, mtime=1777502853239, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=236)) (connection.py:410, _read_response) 2026-04-29 22:47:54 [ 539 ] DEBUG : Sending request(xid=200): GetData(path='/test_snapshot_multinode_recover197', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:54 [ 539 ] DEBUG : Received response(xid=200): (b'somedata197', ZnodeStat(czxid=236, mzxid=236, ctime=1777502853239, mtime=1777502853239, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=236)) (connection.py:410, _read_response) 2026-04-29 22:47:54 [ 539 ] DEBUG : Sending request(xid=201): GetData(path='/test_snapshot_multinode_recover198', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:54 [ 539 ] DEBUG : Received response(xid=201): (b'somedata198', ZnodeStat(czxid=237, mzxid=237, ctime=1777502853273, mtime=1777502853273, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=237)) (connection.py:410, _read_response) 2026-04-29 22:47:54 [ 539 ] DEBUG : Sending request(xid=201): GetData(path='/test_snapshot_multinode_recover198', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:54 [ 539 ] DEBUG : Received response(xid=201): (b'somedata198', ZnodeStat(czxid=237, mzxid=237, ctime=1777502853273, mtime=1777502853273, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=237)) (connection.py:410, _read_response) 2026-04-29 22:47:54 [ 539 ] DEBUG : Sending request(xid=201): GetData(path='/test_snapshot_multinode_recover198', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:54 [ 539 ] DEBUG : Received response(xid=201): (b'somedata198', ZnodeStat(czxid=237, mzxid=237, ctime=1777502853273, mtime=1777502853273, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=237)) (connection.py:410, _read_response) 2026-04-29 22:47:55 [ 539 ] DEBUG : Sending request(xid=202): GetData(path='/test_snapshot_multinode_recover199', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:55 [ 539 ] DEBUG : Received response(xid=202): (b'somedata199', ZnodeStat(czxid=238, mzxid=238, ctime=1777502853284, mtime=1777502853284, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=238)) (connection.py:410, _read_response) 2026-04-29 22:47:55 [ 539 ] DEBUG : Sending request(xid=202): GetData(path='/test_snapshot_multinode_recover199', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:55 [ 539 ] DEBUG : Received response(xid=202): (b'somedata199', ZnodeStat(czxid=238, mzxid=238, ctime=1777502853284, mtime=1777502853284, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=238)) (connection.py:410, _read_response) 2026-04-29 22:47:55 [ 539 ] DEBUG : Sending request(xid=202): GetData(path='/test_snapshot_multinode_recover199', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:55 [ 539 ] DEBUG : Received response(xid=202): (b'somedata199', ZnodeStat(czxid=238, mzxid=238, ctime=1777502853284, mtime=1777502853284, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=238)) (connection.py:410, _read_response) 2026-04-29 22:47:55 [ 539 ] DEBUG : Sending request(xid=203): Exists(path='/test_snapshot_multinode_recover200', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:55 [ 539 ] DEBUG : Sending request(xid=203): Exists(path='/test_snapshot_multinode_recover200', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:55 [ 539 ] DEBUG : Sending request(xid=203): Exists(path='/test_snapshot_multinode_recover200', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:55 [ 539 ] DEBUG : Sending request(xid=204): GetData(path='/test_snapshot_multinode_recover201', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:55 [ 539 ] DEBUG : Received response(xid=204): (b'somedata201', ZnodeStat(czxid=240, mzxid=240, ctime=1777502853330, mtime=1777502853330, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=240)) (connection.py:410, _read_response) 2026-04-29 22:47:55 [ 539 ] DEBUG : Sending request(xid=204): GetData(path='/test_snapshot_multinode_recover201', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:55 [ 539 ] DEBUG : Received response(xid=204): (b'somedata201', ZnodeStat(czxid=240, mzxid=240, ctime=1777502853330, mtime=1777502853330, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=240)) (connection.py:410, _read_response) 2026-04-29 22:47:55 [ 539 ] DEBUG : Sending request(xid=204): GetData(path='/test_snapshot_multinode_recover201', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:55 [ 539 ] DEBUG : Received response(xid=204): (b'somedata201', ZnodeStat(czxid=240, mzxid=240, ctime=1777502853330, mtime=1777502853330, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=240)) (connection.py:410, _read_response) 2026-04-29 22:47:55 [ 539 ] DEBUG : Sending request(xid=205): GetData(path='/test_snapshot_multinode_recover202', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:55 [ 539 ] DEBUG : Received response(xid=205): (b'somedata202', ZnodeStat(czxid=241, mzxid=241, ctime=1777502853359, mtime=1777502853359, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=241)) (connection.py:410, _read_response) 2026-04-29 22:47:55 [ 539 ] DEBUG : Sending request(xid=205): GetData(path='/test_snapshot_multinode_recover202', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:55 [ 539 ] DEBUG : Received response(xid=205): (b'somedata202', ZnodeStat(czxid=241, mzxid=241, ctime=1777502853359, mtime=1777502853359, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=241)) (connection.py:410, _read_response) 2026-04-29 22:47:55 [ 539 ] DEBUG : Sending request(xid=205): GetData(path='/test_snapshot_multinode_recover202', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:55 [ 539 ] DEBUG : Received response(xid=205): (b'somedata202', ZnodeStat(czxid=241, mzxid=241, ctime=1777502853359, mtime=1777502853359, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=241)) (connection.py:410, _read_response) 2026-04-29 22:47:55 [ 539 ] DEBUG : Sending request(xid=206): GetData(path='/test_snapshot_multinode_recover203', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:55 [ 539 ] DEBUG : Received response(xid=206): (b'somedata203', ZnodeStat(czxid=242, mzxid=242, ctime=1777502853397, mtime=1777502853397, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=242)) (connection.py:410, _read_response) 2026-04-29 22:47:55 [ 539 ] DEBUG : Sending request(xid=206): GetData(path='/test_snapshot_multinode_recover203', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:55 [ 539 ] DEBUG : Received response(xid=206): (b'somedata203', ZnodeStat(czxid=242, mzxid=242, ctime=1777502853397, mtime=1777502853397, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=242)) (connection.py:410, _read_response) 2026-04-29 22:47:55 [ 539 ] DEBUG : Sending request(xid=206): GetData(path='/test_snapshot_multinode_recover203', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:55 [ 539 ] DEBUG : Received response(xid=206): (b'somedata203', ZnodeStat(czxid=242, mzxid=242, ctime=1777502853397, mtime=1777502853397, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=242)) (connection.py:410, _read_response) 2026-04-29 22:47:55 [ 539 ] DEBUG : Sending request(xid=207): GetData(path='/test_snapshot_multinode_recover204', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:55 [ 539 ] DEBUG : Received response(xid=207): (b'somedata204', ZnodeStat(czxid=243, mzxid=243, ctime=1777502853448, mtime=1777502853448, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=243)) (connection.py:410, _read_response) 2026-04-29 22:47:55 [ 539 ] DEBUG : Sending request(xid=207): GetData(path='/test_snapshot_multinode_recover204', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:55 [ 539 ] DEBUG : Received response(xid=207): (b'somedata204', ZnodeStat(czxid=243, mzxid=243, ctime=1777502853448, mtime=1777502853448, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=243)) (connection.py:410, _read_response) 2026-04-29 22:47:55 [ 539 ] DEBUG : Sending request(xid=207): GetData(path='/test_snapshot_multinode_recover204', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:55 [ 539 ] DEBUG : Received response(xid=207): (b'somedata204', ZnodeStat(czxid=243, mzxid=243, ctime=1777502853448, mtime=1777502853448, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=243)) (connection.py:410, _read_response) 2026-04-29 22:47:55 [ 539 ] DEBUG : Sending request(xid=208): GetData(path='/test_snapshot_multinode_recover205', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:55 [ 539 ] DEBUG : Received response(xid=208): (b'somedata205', ZnodeStat(czxid=244, mzxid=244, ctime=1777502853472, mtime=1777502853472, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=244)) (connection.py:410, _read_response) 2026-04-29 22:47:55 [ 539 ] DEBUG : Sending request(xid=208): GetData(path='/test_snapshot_multinode_recover205', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:55 [ 539 ] DEBUG : Received response(xid=208): (b'somedata205', ZnodeStat(czxid=244, mzxid=244, ctime=1777502853472, mtime=1777502853472, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=244)) (connection.py:410, _read_response) 2026-04-29 22:47:55 [ 539 ] DEBUG : Sending request(xid=208): GetData(path='/test_snapshot_multinode_recover205', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:55 [ 539 ] DEBUG : Received response(xid=208): (b'somedata205', ZnodeStat(czxid=244, mzxid=244, ctime=1777502853472, mtime=1777502853472, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=244)) (connection.py:410, _read_response) 2026-04-29 22:47:55 [ 539 ] DEBUG : Sending request(xid=209): GetData(path='/test_snapshot_multinode_recover206', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:55 [ 539 ] DEBUG : Received response(xid=209): (b'somedata206', ZnodeStat(czxid=245, mzxid=245, ctime=1777502853495, mtime=1777502853495, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=245)) (connection.py:410, _read_response) 2026-04-29 22:47:55 [ 539 ] DEBUG : Sending request(xid=209): GetData(path='/test_snapshot_multinode_recover206', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:55 [ 539 ] DEBUG : Received response(xid=209): (b'somedata206', ZnodeStat(czxid=245, mzxid=245, ctime=1777502853495, mtime=1777502853495, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=245)) (connection.py:410, _read_response) 2026-04-29 22:47:55 [ 539 ] DEBUG : Sending request(xid=209): GetData(path='/test_snapshot_multinode_recover206', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:55 [ 539 ] DEBUG : Received response(xid=209): (b'somedata206', ZnodeStat(czxid=245, mzxid=245, ctime=1777502853495, mtime=1777502853495, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=245)) (connection.py:410, _read_response) 2026-04-29 22:47:55 [ 539 ] DEBUG : Sending request(xid=210): GetData(path='/test_snapshot_multinode_recover207', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:55 [ 539 ] DEBUG : Received response(xid=210): (b'somedata207', ZnodeStat(czxid=246, mzxid=246, ctime=1777502853517, mtime=1777502853517, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=246)) (connection.py:410, _read_response) 2026-04-29 22:47:55 [ 539 ] DEBUG : Sending request(xid=210): GetData(path='/test_snapshot_multinode_recover207', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:55 [ 539 ] DEBUG : Received response(xid=210): (b'somedata207', ZnodeStat(czxid=246, mzxid=246, ctime=1777502853517, mtime=1777502853517, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=246)) (connection.py:410, _read_response) 2026-04-29 22:47:55 [ 539 ] DEBUG : Sending request(xid=210): GetData(path='/test_snapshot_multinode_recover207', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:55 [ 539 ] DEBUG : Received response(xid=210): (b'somedata207', ZnodeStat(czxid=246, mzxid=246, ctime=1777502853517, mtime=1777502853517, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=246)) (connection.py:410, _read_response) 2026-04-29 22:47:55 [ 539 ] DEBUG : Sending request(xid=211): GetData(path='/test_snapshot_multinode_recover208', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:55 [ 539 ] DEBUG : Received response(xid=211): (b'somedata208', ZnodeStat(czxid=247, mzxid=247, ctime=1777502853564, mtime=1777502853564, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=247)) (connection.py:410, _read_response) 2026-04-29 22:47:55 [ 539 ] DEBUG : Sending request(xid=211): GetData(path='/test_snapshot_multinode_recover208', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:55 [ 539 ] DEBUG : Received response(xid=211): (b'somedata208', ZnodeStat(czxid=247, mzxid=247, ctime=1777502853564, mtime=1777502853564, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=247)) (connection.py:410, _read_response) 2026-04-29 22:47:55 [ 539 ] DEBUG : Sending request(xid=211): GetData(path='/test_snapshot_multinode_recover208', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:55 [ 539 ] DEBUG : Received response(xid=211): (b'somedata208', ZnodeStat(czxid=247, mzxid=247, ctime=1777502853564, mtime=1777502853564, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=247)) (connection.py:410, _read_response) 2026-04-29 22:47:55 [ 539 ] DEBUG : Sending request(xid=212): GetData(path='/test_snapshot_multinode_recover209', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:55 [ 539 ] DEBUG : Received response(xid=212): (b'somedata209', ZnodeStat(czxid=248, mzxid=248, ctime=1777502853606, mtime=1777502853606, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=248)) (connection.py:410, _read_response) 2026-04-29 22:47:55 [ 539 ] DEBUG : Sending request(xid=212): GetData(path='/test_snapshot_multinode_recover209', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:55 [ 539 ] DEBUG : Received response(xid=212): (b'somedata209', ZnodeStat(czxid=248, mzxid=248, ctime=1777502853606, mtime=1777502853606, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=248)) (connection.py:410, _read_response) 2026-04-29 22:47:55 [ 539 ] DEBUG : Sending request(xid=212): GetData(path='/test_snapshot_multinode_recover209', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:55 [ 539 ] DEBUG : Received response(xid=212): (b'somedata209', ZnodeStat(czxid=248, mzxid=248, ctime=1777502853606, mtime=1777502853606, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=248)) (connection.py:410, _read_response) 2026-04-29 22:47:55 [ 539 ] DEBUG : Sending request(xid=213): Exists(path='/test_snapshot_multinode_recover210', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:55 [ 539 ] DEBUG : Sending request(xid=213): Exists(path='/test_snapshot_multinode_recover210', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:55 [ 539 ] DEBUG : Sending request(xid=213): Exists(path='/test_snapshot_multinode_recover210', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:55 [ 539 ] DEBUG : Sending request(xid=214): GetData(path='/test_snapshot_multinode_recover211', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:55 [ 539 ] DEBUG : Received response(xid=214): (b'somedata211', ZnodeStat(czxid=250, mzxid=250, ctime=1777502853674, mtime=1777502853674, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=250)) (connection.py:410, _read_response) 2026-04-29 22:47:55 [ 539 ] DEBUG : Sending request(xid=214): GetData(path='/test_snapshot_multinode_recover211', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:55 [ 539 ] DEBUG : Received response(xid=214): (b'somedata211', ZnodeStat(czxid=250, mzxid=250, ctime=1777502853674, mtime=1777502853674, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=250)) (connection.py:410, _read_response) 2026-04-29 22:47:55 [ 539 ] DEBUG : Sending request(xid=214): GetData(path='/test_snapshot_multinode_recover211', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:55 [ 539 ] DEBUG : Received response(xid=214): (b'somedata211', ZnodeStat(czxid=250, mzxid=250, ctime=1777502853674, mtime=1777502853674, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=250)) (connection.py:410, _read_response) 2026-04-29 22:47:55 [ 539 ] DEBUG : Sending request(xid=215): GetData(path='/test_snapshot_multinode_recover212', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:55 [ 539 ] DEBUG : Received response(xid=215): (b'somedata212', ZnodeStat(czxid=251, mzxid=251, ctime=1777502853699, mtime=1777502853699, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=251)) (connection.py:410, _read_response) 2026-04-29 22:47:55 [ 539 ] DEBUG : Sending request(xid=215): GetData(path='/test_snapshot_multinode_recover212', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:55 [ 539 ] DEBUG : Received response(xid=215): (b'somedata212', ZnodeStat(czxid=251, mzxid=251, ctime=1777502853699, mtime=1777502853699, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=251)) (connection.py:410, _read_response) 2026-04-29 22:47:55 [ 539 ] DEBUG : Sending request(xid=215): GetData(path='/test_snapshot_multinode_recover212', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:55 [ 539 ] DEBUG : Received response(xid=215): (b'somedata212', ZnodeStat(czxid=251, mzxid=251, ctime=1777502853699, mtime=1777502853699, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=251)) (connection.py:410, _read_response) 2026-04-29 22:47:55 [ 539 ] DEBUG : Sending request(xid=216): GetData(path='/test_snapshot_multinode_recover213', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:55 [ 539 ] DEBUG : Received response(xid=216): (b'somedata213', ZnodeStat(czxid=252, mzxid=252, ctime=1777502853713, mtime=1777502853713, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=252)) (connection.py:410, _read_response) 2026-04-29 22:47:55 [ 539 ] DEBUG : Sending request(xid=216): GetData(path='/test_snapshot_multinode_recover213', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:55 [ 539 ] DEBUG : Received response(xid=216): (b'somedata213', ZnodeStat(czxid=252, mzxid=252, ctime=1777502853713, mtime=1777502853713, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=252)) (connection.py:410, _read_response) 2026-04-29 22:47:55 [ 539 ] DEBUG : Sending request(xid=216): GetData(path='/test_snapshot_multinode_recover213', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:55 [ 539 ] DEBUG : Received response(xid=216): (b'somedata213', ZnodeStat(czxid=252, mzxid=252, ctime=1777502853713, mtime=1777502853713, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=252)) (connection.py:410, _read_response) 2026-04-29 22:47:55 [ 539 ] DEBUG : Sending request(xid=217): GetData(path='/test_snapshot_multinode_recover214', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:55 [ 539 ] DEBUG : Received response(xid=217): (b'somedata214', ZnodeStat(czxid=253, mzxid=253, ctime=1777502853735, mtime=1777502853735, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=253)) (connection.py:410, _read_response) 2026-04-29 22:47:55 [ 539 ] DEBUG : Sending request(xid=217): GetData(path='/test_snapshot_multinode_recover214', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:55 [ 539 ] DEBUG : Received response(xid=217): (b'somedata214', ZnodeStat(czxid=253, mzxid=253, ctime=1777502853735, mtime=1777502853735, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=253)) (connection.py:410, _read_response) 2026-04-29 22:47:55 [ 539 ] DEBUG : Sending request(xid=217): GetData(path='/test_snapshot_multinode_recover214', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:55 [ 539 ] DEBUG : Received response(xid=217): (b'somedata214', ZnodeStat(czxid=253, mzxid=253, ctime=1777502853735, mtime=1777502853735, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=253)) (connection.py:410, _read_response) 2026-04-29 22:47:55 [ 539 ] DEBUG : Sending request(xid=218): GetData(path='/test_snapshot_multinode_recover215', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:55 [ 539 ] DEBUG : Received response(xid=218): (b'somedata215', ZnodeStat(czxid=254, mzxid=254, ctime=1777502853757, mtime=1777502853757, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=254)) (connection.py:410, _read_response) 2026-04-29 22:47:55 [ 539 ] DEBUG : Sending request(xid=218): GetData(path='/test_snapshot_multinode_recover215', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:55 [ 539 ] DEBUG : Received response(xid=218): (b'somedata215', ZnodeStat(czxid=254, mzxid=254, ctime=1777502853757, mtime=1777502853757, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=254)) (connection.py:410, _read_response) 2026-04-29 22:47:55 [ 539 ] DEBUG : Sending request(xid=218): GetData(path='/test_snapshot_multinode_recover215', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:55 [ 539 ] DEBUG : Received response(xid=218): (b'somedata215', ZnodeStat(czxid=254, mzxid=254, ctime=1777502853757, mtime=1777502853757, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=254)) (connection.py:410, _read_response) 2026-04-29 22:47:55 [ 539 ] DEBUG : Sending request(xid=219): GetData(path='/test_snapshot_multinode_recover216', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:55 [ 539 ] DEBUG : Received response(xid=219): (b'somedata216', ZnodeStat(czxid=255, mzxid=255, ctime=1777502853777, mtime=1777502853777, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=255)) (connection.py:410, _read_response) 2026-04-29 22:47:55 [ 539 ] DEBUG : Sending request(xid=219): GetData(path='/test_snapshot_multinode_recover216', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:55 [ 539 ] DEBUG : Received response(xid=219): (b'somedata216', ZnodeStat(czxid=255, mzxid=255, ctime=1777502853777, mtime=1777502853777, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=255)) (connection.py:410, _read_response) 2026-04-29 22:47:55 [ 539 ] DEBUG : Sending request(xid=219): GetData(path='/test_snapshot_multinode_recover216', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:55 [ 539 ] DEBUG : Received response(xid=219): (b'somedata216', ZnodeStat(czxid=255, mzxid=255, ctime=1777502853777, mtime=1777502853777, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=255)) (connection.py:410, _read_response) 2026-04-29 22:47:55 [ 539 ] DEBUG : Sending request(xid=220): GetData(path='/test_snapshot_multinode_recover217', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:55 [ 539 ] DEBUG : Received response(xid=220): (b'somedata217', ZnodeStat(czxid=256, mzxid=256, ctime=1777502853803, mtime=1777502853803, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=256)) (connection.py:410, _read_response) 2026-04-29 22:47:55 [ 539 ] DEBUG : Sending request(xid=220): GetData(path='/test_snapshot_multinode_recover217', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:55 [ 539 ] DEBUG : Received response(xid=220): (b'somedata217', ZnodeStat(czxid=256, mzxid=256, ctime=1777502853803, mtime=1777502853803, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=256)) (connection.py:410, _read_response) 2026-04-29 22:47:55 [ 539 ] DEBUG : Sending request(xid=220): GetData(path='/test_snapshot_multinode_recover217', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:55 [ 539 ] DEBUG : Received response(xid=220): (b'somedata217', ZnodeStat(czxid=256, mzxid=256, ctime=1777502853803, mtime=1777502853803, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=256)) (connection.py:410, _read_response) 2026-04-29 22:47:55 [ 539 ] DEBUG : Sending request(xid=221): GetData(path='/test_snapshot_multinode_recover218', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:55 [ 539 ] DEBUG : Received response(xid=221): (b'somedata218', ZnodeStat(czxid=257, mzxid=257, ctime=1777502853818, mtime=1777502853818, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=257)) (connection.py:410, _read_response) 2026-04-29 22:47:55 [ 539 ] DEBUG : Sending request(xid=221): GetData(path='/test_snapshot_multinode_recover218', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:55 [ 539 ] DEBUG : Received response(xid=221): (b'somedata218', ZnodeStat(czxid=257, mzxid=257, ctime=1777502853818, mtime=1777502853818, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=257)) (connection.py:410, _read_response) 2026-04-29 22:47:55 [ 539 ] DEBUG : Sending request(xid=221): GetData(path='/test_snapshot_multinode_recover218', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:55 [ 539 ] DEBUG : Received response(xid=221): (b'somedata218', ZnodeStat(czxid=257, mzxid=257, ctime=1777502853818, mtime=1777502853818, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=257)) (connection.py:410, _read_response) 2026-04-29 22:47:55 [ 539 ] DEBUG : Sending request(xid=222): GetData(path='/test_snapshot_multinode_recover219', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:55 [ 539 ] DEBUG : Received response(xid=222): (b'somedata219', ZnodeStat(czxid=258, mzxid=258, ctime=1777502853834, mtime=1777502853834, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=258)) (connection.py:410, _read_response) 2026-04-29 22:47:55 [ 539 ] DEBUG : Sending request(xid=222): GetData(path='/test_snapshot_multinode_recover219', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:55 [ 539 ] DEBUG : Received response(xid=222): (b'somedata219', ZnodeStat(czxid=258, mzxid=258, ctime=1777502853834, mtime=1777502853834, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=258)) (connection.py:410, _read_response) 2026-04-29 22:47:55 [ 539 ] DEBUG : Sending request(xid=222): GetData(path='/test_snapshot_multinode_recover219', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:55 [ 539 ] DEBUG : Received response(xid=222): (b'somedata219', ZnodeStat(czxid=258, mzxid=258, ctime=1777502853834, mtime=1777502853834, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=258)) (connection.py:410, _read_response) 2026-04-29 22:47:55 [ 539 ] DEBUG : Sending request(xid=223): Exists(path='/test_snapshot_multinode_recover220', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:55 [ 539 ] DEBUG : Sending request(xid=223): Exists(path='/test_snapshot_multinode_recover220', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:55 [ 539 ] DEBUG : Sending request(xid=223): Exists(path='/test_snapshot_multinode_recover220', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:55 [ 539 ] DEBUG : Sending request(xid=224): GetData(path='/test_snapshot_multinode_recover221', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:55 [ 539 ] DEBUG : Received response(xid=224): (b'somedata221', ZnodeStat(czxid=260, mzxid=260, ctime=1777502853865, mtime=1777502853865, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=260)) (connection.py:410, _read_response) 2026-04-29 22:47:55 [ 539 ] DEBUG : Sending request(xid=224): GetData(path='/test_snapshot_multinode_recover221', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:55 [ 539 ] DEBUG : Received response(xid=224): (b'somedata221', ZnodeStat(czxid=260, mzxid=260, ctime=1777502853865, mtime=1777502853865, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=260)) (connection.py:410, _read_response) 2026-04-29 22:47:55 [ 539 ] DEBUG : Sending request(xid=224): GetData(path='/test_snapshot_multinode_recover221', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:55 [ 539 ] DEBUG : Received response(xid=224): (b'somedata221', ZnodeStat(czxid=260, mzxid=260, ctime=1777502853865, mtime=1777502853865, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=260)) (connection.py:410, _read_response) 2026-04-29 22:47:55 [ 539 ] DEBUG : Sending request(xid=225): GetData(path='/test_snapshot_multinode_recover222', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:55 [ 539 ] DEBUG : Received response(xid=225): (b'somedata222', ZnodeStat(czxid=261, mzxid=261, ctime=1777502853883, mtime=1777502853883, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=261)) (connection.py:410, _read_response) 2026-04-29 22:47:55 [ 539 ] DEBUG : Sending request(xid=225): GetData(path='/test_snapshot_multinode_recover222', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:55 [ 539 ] DEBUG : Received response(xid=225): (b'somedata222', ZnodeStat(czxid=261, mzxid=261, ctime=1777502853883, mtime=1777502853883, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=261)) (connection.py:410, _read_response) 2026-04-29 22:47:55 [ 539 ] DEBUG : Sending request(xid=225): GetData(path='/test_snapshot_multinode_recover222', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:55 [ 539 ] DEBUG : Received response(xid=225): (b'somedata222', ZnodeStat(czxid=261, mzxid=261, ctime=1777502853883, mtime=1777502853883, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=261)) (connection.py:410, _read_response) 2026-04-29 22:47:55 [ 539 ] DEBUG : Sending request(xid=226): GetData(path='/test_snapshot_multinode_recover223', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:55 [ 539 ] DEBUG : Received response(xid=226): (b'somedata223', ZnodeStat(czxid=262, mzxid=262, ctime=1777502853904, mtime=1777502853904, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=262)) (connection.py:410, _read_response) 2026-04-29 22:47:55 [ 539 ] DEBUG : Sending request(xid=226): GetData(path='/test_snapshot_multinode_recover223', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:55 [ 539 ] DEBUG : Received response(xid=226): (b'somedata223', ZnodeStat(czxid=262, mzxid=262, ctime=1777502853904, mtime=1777502853904, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=262)) (connection.py:410, _read_response) 2026-04-29 22:47:55 [ 539 ] DEBUG : Sending request(xid=226): GetData(path='/test_snapshot_multinode_recover223', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:55 [ 539 ] DEBUG : Received response(xid=226): (b'somedata223', ZnodeStat(czxid=262, mzxid=262, ctime=1777502853904, mtime=1777502853904, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=262)) (connection.py:410, _read_response) 2026-04-29 22:47:55 [ 539 ] DEBUG : Sending request(xid=227): GetData(path='/test_snapshot_multinode_recover224', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:55 [ 539 ] DEBUG : Received response(xid=227): (b'somedata224', ZnodeStat(czxid=263, mzxid=263, ctime=1777502853922, mtime=1777502853922, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=263)) (connection.py:410, _read_response) 2026-04-29 22:47:55 [ 539 ] DEBUG : Sending request(xid=227): GetData(path='/test_snapshot_multinode_recover224', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:55 [ 539 ] DEBUG : Received response(xid=227): (b'somedata224', ZnodeStat(czxid=263, mzxid=263, ctime=1777502853922, mtime=1777502853922, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=263)) (connection.py:410, _read_response) 2026-04-29 22:47:55 [ 539 ] DEBUG : Sending request(xid=227): GetData(path='/test_snapshot_multinode_recover224', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:55 [ 539 ] DEBUG : Received response(xid=227): (b'somedata224', ZnodeStat(czxid=263, mzxid=263, ctime=1777502853922, mtime=1777502853922, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=263)) (connection.py:410, _read_response) 2026-04-29 22:47:55 [ 539 ] DEBUG : Sending request(xid=228): GetData(path='/test_snapshot_multinode_recover225', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:55 [ 539 ] DEBUG : Received response(xid=228): (b'somedata225', ZnodeStat(czxid=264, mzxid=264, ctime=1777502853934, mtime=1777502853934, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=264)) (connection.py:410, _read_response) 2026-04-29 22:47:55 [ 539 ] DEBUG : Sending request(xid=228): GetData(path='/test_snapshot_multinode_recover225', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:55 [ 539 ] DEBUG : Received response(xid=228): (b'somedata225', ZnodeStat(czxid=264, mzxid=264, ctime=1777502853934, mtime=1777502853934, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=264)) (connection.py:410, _read_response) 2026-04-29 22:47:55 [ 539 ] DEBUG : Sending request(xid=228): GetData(path='/test_snapshot_multinode_recover225', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:55 [ 539 ] DEBUG : Received response(xid=228): (b'somedata225', ZnodeStat(czxid=264, mzxid=264, ctime=1777502853934, mtime=1777502853934, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=264)) (connection.py:410, _read_response) 2026-04-29 22:47:55 [ 539 ] DEBUG : Sending request(xid=229): GetData(path='/test_snapshot_multinode_recover226', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:55 [ 539 ] DEBUG : Received response(xid=229): (b'somedata226', ZnodeStat(czxid=265, mzxid=265, ctime=1777502853945, mtime=1777502853945, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=265)) (connection.py:410, _read_response) 2026-04-29 22:47:55 [ 539 ] DEBUG : Sending request(xid=229): GetData(path='/test_snapshot_multinode_recover226', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:55 [ 539 ] DEBUG : Received response(xid=229): (b'somedata226', ZnodeStat(czxid=265, mzxid=265, ctime=1777502853945, mtime=1777502853945, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=265)) (connection.py:410, _read_response) 2026-04-29 22:47:55 [ 539 ] DEBUG : Sending request(xid=229): GetData(path='/test_snapshot_multinode_recover226', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:55 [ 539 ] DEBUG : Received response(xid=229): (b'somedata226', ZnodeStat(czxid=265, mzxid=265, ctime=1777502853945, mtime=1777502853945, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=265)) (connection.py:410, _read_response) 2026-04-29 22:47:55 [ 539 ] DEBUG : Sending request(xid=230): GetData(path='/test_snapshot_multinode_recover227', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:55 [ 539 ] DEBUG : Received response(xid=230): (b'somedata227', ZnodeStat(czxid=266, mzxid=266, ctime=1777502853955, mtime=1777502853955, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=266)) (connection.py:410, _read_response) 2026-04-29 22:47:55 [ 539 ] DEBUG : Sending request(xid=230): GetData(path='/test_snapshot_multinode_recover227', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:55 [ 539 ] DEBUG : Received response(xid=230): (b'somedata227', ZnodeStat(czxid=266, mzxid=266, ctime=1777502853955, mtime=1777502853955, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=266)) (connection.py:410, _read_response) 2026-04-29 22:47:55 [ 539 ] DEBUG : Sending request(xid=230): GetData(path='/test_snapshot_multinode_recover227', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:55 [ 539 ] DEBUG : Received response(xid=230): (b'somedata227', ZnodeStat(czxid=266, mzxid=266, ctime=1777502853955, mtime=1777502853955, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=266)) (connection.py:410, _read_response) 2026-04-29 22:47:55 [ 539 ] DEBUG : Sending request(xid=231): GetData(path='/test_snapshot_multinode_recover228', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:55 [ 539 ] DEBUG : Received response(xid=231): (b'somedata228', ZnodeStat(czxid=267, mzxid=267, ctime=1777502853974, mtime=1777502853974, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=267)) (connection.py:410, _read_response) 2026-04-29 22:47:55 [ 539 ] DEBUG : Sending request(xid=231): GetData(path='/test_snapshot_multinode_recover228', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:55 [ 539 ] DEBUG : Received response(xid=231): (b'somedata228', ZnodeStat(czxid=267, mzxid=267, ctime=1777502853974, mtime=1777502853974, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=267)) (connection.py:410, _read_response) 2026-04-29 22:47:55 [ 539 ] DEBUG : Sending request(xid=231): GetData(path='/test_snapshot_multinode_recover228', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:55 [ 539 ] DEBUG : Received response(xid=231): (b'somedata228', ZnodeStat(czxid=267, mzxid=267, ctime=1777502853974, mtime=1777502853974, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=267)) (connection.py:410, _read_response) 2026-04-29 22:47:55 [ 539 ] DEBUG : Sending request(xid=232): GetData(path='/test_snapshot_multinode_recover229', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:55 [ 539 ] DEBUG : Received response(xid=232): (b'somedata229', ZnodeStat(czxid=268, mzxid=268, ctime=1777502853988, mtime=1777502853988, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=268)) (connection.py:410, _read_response) 2026-04-29 22:47:55 [ 539 ] DEBUG : Sending request(xid=232): GetData(path='/test_snapshot_multinode_recover229', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:55 [ 539 ] DEBUG : Received response(xid=232): (b'somedata229', ZnodeStat(czxid=268, mzxid=268, ctime=1777502853988, mtime=1777502853988, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=268)) (connection.py:410, _read_response) 2026-04-29 22:47:55 [ 539 ] DEBUG : Sending request(xid=232): GetData(path='/test_snapshot_multinode_recover229', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:55 [ 539 ] DEBUG : Received response(xid=232): (b'somedata229', ZnodeStat(czxid=268, mzxid=268, ctime=1777502853988, mtime=1777502853988, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=268)) (connection.py:410, _read_response) 2026-04-29 22:47:56 [ 539 ] DEBUG : Sending request(xid=233): Exists(path='/test_snapshot_multinode_recover230', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:56 [ 539 ] DEBUG : Sending request(xid=233): Exists(path='/test_snapshot_multinode_recover230', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:56 [ 539 ] DEBUG : Sending request(xid=233): Exists(path='/test_snapshot_multinode_recover230', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:56 [ 539 ] DEBUG : Sending request(xid=234): GetData(path='/test_snapshot_multinode_recover231', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:56 [ 539 ] DEBUG : Received response(xid=234): (b'somedata231', ZnodeStat(czxid=270, mzxid=270, ctime=1777502854032, mtime=1777502854032, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=270)) (connection.py:410, _read_response) 2026-04-29 22:47:56 [ 539 ] DEBUG : Sending request(xid=234): GetData(path='/test_snapshot_multinode_recover231', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:56 [ 539 ] DEBUG : Received response(xid=234): (b'somedata231', ZnodeStat(czxid=270, mzxid=270, ctime=1777502854032, mtime=1777502854032, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=270)) (connection.py:410, _read_response) 2026-04-29 22:47:56 [ 539 ] DEBUG : Sending request(xid=234): GetData(path='/test_snapshot_multinode_recover231', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:56 [ 539 ] DEBUG : Received response(xid=234): (b'somedata231', ZnodeStat(czxid=270, mzxid=270, ctime=1777502854032, mtime=1777502854032, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=270)) (connection.py:410, _read_response) 2026-04-29 22:47:56 [ 539 ] DEBUG : Sending request(xid=235): GetData(path='/test_snapshot_multinode_recover232', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:56 [ 539 ] DEBUG : Received response(xid=235): (b'somedata232', ZnodeStat(czxid=271, mzxid=271, ctime=1777502854047, mtime=1777502854047, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=271)) (connection.py:410, _read_response) 2026-04-29 22:47:56 [ 539 ] DEBUG : Sending request(xid=235): GetData(path='/test_snapshot_multinode_recover232', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:56 [ 539 ] DEBUG : Received response(xid=235): (b'somedata232', ZnodeStat(czxid=271, mzxid=271, ctime=1777502854047, mtime=1777502854047, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=271)) (connection.py:410, _read_response) 2026-04-29 22:47:56 [ 539 ] DEBUG : Sending request(xid=235): GetData(path='/test_snapshot_multinode_recover232', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:56 [ 539 ] DEBUG : Received response(xid=235): (b'somedata232', ZnodeStat(czxid=271, mzxid=271, ctime=1777502854047, mtime=1777502854047, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=271)) (connection.py:410, _read_response) 2026-04-29 22:47:56 [ 539 ] DEBUG : Sending request(xid=236): GetData(path='/test_snapshot_multinode_recover233', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:56 [ 539 ] DEBUG : Received response(xid=236): (b'somedata233', ZnodeStat(czxid=272, mzxid=272, ctime=1777502854060, mtime=1777502854060, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=272)) (connection.py:410, _read_response) 2026-04-29 22:47:56 [ 539 ] DEBUG : Sending request(xid=236): GetData(path='/test_snapshot_multinode_recover233', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:56 [ 539 ] DEBUG : Received response(xid=236): (b'somedata233', ZnodeStat(czxid=272, mzxid=272, ctime=1777502854060, mtime=1777502854060, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=272)) (connection.py:410, _read_response) 2026-04-29 22:47:56 [ 539 ] DEBUG : Sending request(xid=236): GetData(path='/test_snapshot_multinode_recover233', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:56 [ 539 ] DEBUG : Received response(xid=236): (b'somedata233', ZnodeStat(czxid=272, mzxid=272, ctime=1777502854060, mtime=1777502854060, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=272)) (connection.py:410, _read_response) 2026-04-29 22:47:56 [ 539 ] DEBUG : Sending request(xid=237): GetData(path='/test_snapshot_multinode_recover234', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:56 [ 539 ] DEBUG : Received response(xid=237): (b'somedata234', ZnodeStat(czxid=273, mzxid=273, ctime=1777502854103, mtime=1777502854103, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=273)) (connection.py:410, _read_response) 2026-04-29 22:47:56 [ 539 ] DEBUG : Sending request(xid=237): GetData(path='/test_snapshot_multinode_recover234', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:56 [ 539 ] DEBUG : Received response(xid=237): (b'somedata234', ZnodeStat(czxid=273, mzxid=273, ctime=1777502854103, mtime=1777502854103, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=273)) (connection.py:410, _read_response) 2026-04-29 22:47:56 [ 539 ] DEBUG : Sending request(xid=237): GetData(path='/test_snapshot_multinode_recover234', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:56 [ 539 ] DEBUG : Received response(xid=237): (b'somedata234', ZnodeStat(czxid=273, mzxid=273, ctime=1777502854103, mtime=1777502854103, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=273)) (connection.py:410, _read_response) 2026-04-29 22:47:56 [ 539 ] DEBUG : Sending request(xid=238): GetData(path='/test_snapshot_multinode_recover235', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:56 [ 539 ] DEBUG : Received response(xid=238): (b'somedata235', ZnodeStat(czxid=274, mzxid=274, ctime=1777502854144, mtime=1777502854144, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=274)) (connection.py:410, _read_response) 2026-04-29 22:47:56 [ 539 ] DEBUG : Sending request(xid=238): GetData(path='/test_snapshot_multinode_recover235', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:56 [ 539 ] DEBUG : Received response(xid=238): (b'somedata235', ZnodeStat(czxid=274, mzxid=274, ctime=1777502854144, mtime=1777502854144, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=274)) (connection.py:410, _read_response) 2026-04-29 22:47:56 [ 539 ] DEBUG : Sending request(xid=238): GetData(path='/test_snapshot_multinode_recover235', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:56 [ 539 ] DEBUG : Received response(xid=238): (b'somedata235', ZnodeStat(czxid=274, mzxid=274, ctime=1777502854144, mtime=1777502854144, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=274)) (connection.py:410, _read_response) 2026-04-29 22:47:56 [ 539 ] DEBUG : Sending request(xid=239): GetData(path='/test_snapshot_multinode_recover236', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:56 [ 539 ] DEBUG : Received response(xid=239): (b'somedata236', ZnodeStat(czxid=275, mzxid=275, ctime=1777502854174, mtime=1777502854174, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=275)) (connection.py:410, _read_response) 2026-04-29 22:47:56 [ 539 ] DEBUG : Sending request(xid=239): GetData(path='/test_snapshot_multinode_recover236', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:56 [ 539 ] DEBUG : Received response(xid=239): (b'somedata236', ZnodeStat(czxid=275, mzxid=275, ctime=1777502854174, mtime=1777502854174, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=275)) (connection.py:410, _read_response) 2026-04-29 22:47:56 [ 539 ] DEBUG : Sending request(xid=239): GetData(path='/test_snapshot_multinode_recover236', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:56 [ 539 ] DEBUG : Received response(xid=239): (b'somedata236', ZnodeStat(czxid=275, mzxid=275, ctime=1777502854174, mtime=1777502854174, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=275)) (connection.py:410, _read_response) 2026-04-29 22:47:56 [ 539 ] DEBUG : Sending request(xid=240): GetData(path='/test_snapshot_multinode_recover237', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:56 [ 539 ] DEBUG : Received response(xid=240): (b'somedata237', ZnodeStat(czxid=276, mzxid=276, ctime=1777502854207, mtime=1777502854207, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=276)) (connection.py:410, _read_response) 2026-04-29 22:47:56 [ 539 ] DEBUG : Sending request(xid=240): GetData(path='/test_snapshot_multinode_recover237', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:56 [ 539 ] DEBUG : Received response(xid=240): (b'somedata237', ZnodeStat(czxid=276, mzxid=276, ctime=1777502854207, mtime=1777502854207, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=276)) (connection.py:410, _read_response) 2026-04-29 22:47:56 [ 539 ] DEBUG : Sending request(xid=240): GetData(path='/test_snapshot_multinode_recover237', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:56 [ 539 ] DEBUG : Received response(xid=240): (b'somedata237', ZnodeStat(czxid=276, mzxid=276, ctime=1777502854207, mtime=1777502854207, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=276)) (connection.py:410, _read_response) 2026-04-29 22:47:56 [ 539 ] DEBUG : Sending request(xid=241): GetData(path='/test_snapshot_multinode_recover238', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:56 [ 539 ] DEBUG : Received response(xid=241): (b'somedata238', ZnodeStat(czxid=277, mzxid=277, ctime=1777502854241, mtime=1777502854241, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=277)) (connection.py:410, _read_response) 2026-04-29 22:47:56 [ 539 ] DEBUG : Sending request(xid=241): GetData(path='/test_snapshot_multinode_recover238', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:56 [ 539 ] DEBUG : Received response(xid=241): (b'somedata238', ZnodeStat(czxid=277, mzxid=277, ctime=1777502854241, mtime=1777502854241, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=277)) (connection.py:410, _read_response) 2026-04-29 22:47:56 [ 539 ] DEBUG : Sending request(xid=241): GetData(path='/test_snapshot_multinode_recover238', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:56 [ 539 ] DEBUG : Received response(xid=241): (b'somedata238', ZnodeStat(czxid=277, mzxid=277, ctime=1777502854241, mtime=1777502854241, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=277)) (connection.py:410, _read_response) 2026-04-29 22:47:56 [ 539 ] DEBUG : Sending request(xid=242): GetData(path='/test_snapshot_multinode_recover239', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:56 [ 539 ] DEBUG : Received response(xid=242): (b'somedata239', ZnodeStat(czxid=278, mzxid=278, ctime=1777502854259, mtime=1777502854259, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=278)) (connection.py:410, _read_response) 2026-04-29 22:47:56 [ 539 ] DEBUG : Sending request(xid=242): GetData(path='/test_snapshot_multinode_recover239', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:56 [ 539 ] DEBUG : Received response(xid=242): (b'somedata239', ZnodeStat(czxid=278, mzxid=278, ctime=1777502854259, mtime=1777502854259, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=278)) (connection.py:410, _read_response) 2026-04-29 22:47:56 [ 539 ] DEBUG : Sending request(xid=242): GetData(path='/test_snapshot_multinode_recover239', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:56 [ 539 ] DEBUG : Received response(xid=242): (b'somedata239', ZnodeStat(czxid=278, mzxid=278, ctime=1777502854259, mtime=1777502854259, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=278)) (connection.py:410, _read_response) 2026-04-29 22:47:56 [ 539 ] DEBUG : Sending request(xid=243): Exists(path='/test_snapshot_multinode_recover240', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:56 [ 539 ] DEBUG : Sending request(xid=243): Exists(path='/test_snapshot_multinode_recover240', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:56 [ 539 ] DEBUG : Sending request(xid=243): Exists(path='/test_snapshot_multinode_recover240', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:56 [ 539 ] DEBUG : Sending request(xid=244): GetData(path='/test_snapshot_multinode_recover241', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:56 [ 539 ] DEBUG : Received response(xid=244): (b'somedata241', ZnodeStat(czxid=280, mzxid=280, ctime=1777502854302, mtime=1777502854302, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=280)) (connection.py:410, _read_response) 2026-04-29 22:47:56 [ 539 ] DEBUG : Sending request(xid=244): GetData(path='/test_snapshot_multinode_recover241', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:56 [ 539 ] DEBUG : Received response(xid=244): (b'somedata241', ZnodeStat(czxid=280, mzxid=280, ctime=1777502854302, mtime=1777502854302, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=280)) (connection.py:410, _read_response) 2026-04-29 22:47:56 [ 539 ] DEBUG : Sending request(xid=244): GetData(path='/test_snapshot_multinode_recover241', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:56 [ 539 ] DEBUG : Received response(xid=244): (b'somedata241', ZnodeStat(czxid=280, mzxid=280, ctime=1777502854302, mtime=1777502854302, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=280)) (connection.py:410, _read_response) 2026-04-29 22:47:56 [ 539 ] DEBUG : Sending request(xid=245): GetData(path='/test_snapshot_multinode_recover242', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:56 [ 539 ] DEBUG : Received response(xid=245): (b'somedata242', ZnodeStat(czxid=281, mzxid=281, ctime=1777502854318, mtime=1777502854318, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=281)) (connection.py:410, _read_response) 2026-04-29 22:47:56 [ 539 ] DEBUG : Sending request(xid=245): GetData(path='/test_snapshot_multinode_recover242', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:56 [ 539 ] DEBUG : Received response(xid=245): (b'somedata242', ZnodeStat(czxid=281, mzxid=281, ctime=1777502854318, mtime=1777502854318, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=281)) (connection.py:410, _read_response) 2026-04-29 22:47:56 [ 539 ] DEBUG : Sending request(xid=245): GetData(path='/test_snapshot_multinode_recover242', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:56 [ 539 ] DEBUG : Received response(xid=245): (b'somedata242', ZnodeStat(czxid=281, mzxid=281, ctime=1777502854318, mtime=1777502854318, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=281)) (connection.py:410, _read_response) 2026-04-29 22:47:56 [ 539 ] DEBUG : Sending request(xid=246): GetData(path='/test_snapshot_multinode_recover243', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:56 [ 539 ] DEBUG : Received response(xid=246): (b'somedata243', ZnodeStat(czxid=282, mzxid=282, ctime=1777502854329, mtime=1777502854329, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=282)) (connection.py:410, _read_response) 2026-04-29 22:47:56 [ 539 ] DEBUG : Sending request(xid=246): GetData(path='/test_snapshot_multinode_recover243', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:56 [ 539 ] DEBUG : Received response(xid=246): (b'somedata243', ZnodeStat(czxid=282, mzxid=282, ctime=1777502854329, mtime=1777502854329, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=282)) (connection.py:410, _read_response) 2026-04-29 22:47:56 [ 539 ] DEBUG : Sending request(xid=246): GetData(path='/test_snapshot_multinode_recover243', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:56 [ 539 ] DEBUG : Received response(xid=246): (b'somedata243', ZnodeStat(czxid=282, mzxid=282, ctime=1777502854329, mtime=1777502854329, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=282)) (connection.py:410, _read_response) 2026-04-29 22:47:56 [ 539 ] DEBUG : Sending request(xid=247): GetData(path='/test_snapshot_multinode_recover244', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:56 [ 539 ] DEBUG : Received response(xid=247): (b'somedata244', ZnodeStat(czxid=283, mzxid=283, ctime=1777502854350, mtime=1777502854350, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=283)) (connection.py:410, _read_response) 2026-04-29 22:47:56 [ 539 ] DEBUG : Sending request(xid=247): GetData(path='/test_snapshot_multinode_recover244', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:56 [ 539 ] DEBUG : Received response(xid=247): (b'somedata244', ZnodeStat(czxid=283, mzxid=283, ctime=1777502854350, mtime=1777502854350, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=283)) (connection.py:410, _read_response) 2026-04-29 22:47:56 [ 539 ] DEBUG : Sending request(xid=247): GetData(path='/test_snapshot_multinode_recover244', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:56 [ 539 ] DEBUG : Received response(xid=247): (b'somedata244', ZnodeStat(czxid=283, mzxid=283, ctime=1777502854350, mtime=1777502854350, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=283)) (connection.py:410, _read_response) 2026-04-29 22:47:56 [ 539 ] DEBUG : Sending request(xid=248): GetData(path='/test_snapshot_multinode_recover245', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:56 [ 539 ] DEBUG : Received response(xid=248): (b'somedata245', ZnodeStat(czxid=284, mzxid=284, ctime=1777502854371, mtime=1777502854371, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=284)) (connection.py:410, _read_response) 2026-04-29 22:47:56 [ 539 ] DEBUG : Sending request(xid=248): GetData(path='/test_snapshot_multinode_recover245', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:56 [ 539 ] DEBUG : Received response(xid=248): (b'somedata245', ZnodeStat(czxid=284, mzxid=284, ctime=1777502854371, mtime=1777502854371, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=284)) (connection.py:410, _read_response) 2026-04-29 22:47:56 [ 539 ] DEBUG : Sending request(xid=248): GetData(path='/test_snapshot_multinode_recover245', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:56 [ 539 ] DEBUG : Received response(xid=248): (b'somedata245', ZnodeStat(czxid=284, mzxid=284, ctime=1777502854371, mtime=1777502854371, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=284)) (connection.py:410, _read_response) 2026-04-29 22:47:56 [ 539 ] DEBUG : Sending request(xid=249): GetData(path='/test_snapshot_multinode_recover246', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:56 [ 539 ] DEBUG : Received response(xid=249): (b'somedata246', ZnodeStat(czxid=285, mzxid=285, ctime=1777502854400, mtime=1777502854400, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=285)) (connection.py:410, _read_response) 2026-04-29 22:47:56 [ 539 ] DEBUG : Sending request(xid=249): GetData(path='/test_snapshot_multinode_recover246', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:56 [ 539 ] DEBUG : Received response(xid=249): (b'somedata246', ZnodeStat(czxid=285, mzxid=285, ctime=1777502854400, mtime=1777502854400, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=285)) (connection.py:410, _read_response) 2026-04-29 22:47:56 [ 539 ] DEBUG : Sending request(xid=249): GetData(path='/test_snapshot_multinode_recover246', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:56 [ 539 ] DEBUG : Received response(xid=249): (b'somedata246', ZnodeStat(czxid=285, mzxid=285, ctime=1777502854400, mtime=1777502854400, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=285)) (connection.py:410, _read_response) 2026-04-29 22:47:56 [ 539 ] DEBUG : Sending request(xid=250): GetData(path='/test_snapshot_multinode_recover247', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:56 [ 539 ] DEBUG : Received response(xid=250): (b'somedata247', ZnodeStat(czxid=286, mzxid=286, ctime=1777502854421, mtime=1777502854421, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=286)) (connection.py:410, _read_response) 2026-04-29 22:47:56 [ 539 ] DEBUG : Sending request(xid=250): GetData(path='/test_snapshot_multinode_recover247', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:56 [ 539 ] DEBUG : Received response(xid=250): (b'somedata247', ZnodeStat(czxid=286, mzxid=286, ctime=1777502854421, mtime=1777502854421, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=286)) (connection.py:410, _read_response) 2026-04-29 22:47:56 [ 539 ] DEBUG : Sending request(xid=250): GetData(path='/test_snapshot_multinode_recover247', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:56 [ 539 ] DEBUG : Received response(xid=250): (b'somedata247', ZnodeStat(czxid=286, mzxid=286, ctime=1777502854421, mtime=1777502854421, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=286)) (connection.py:410, _read_response) 2026-04-29 22:47:56 [ 539 ] DEBUG : Sending request(xid=251): GetData(path='/test_snapshot_multinode_recover248', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:56 [ 539 ] DEBUG : Received response(xid=251): (b'somedata248', ZnodeStat(czxid=287, mzxid=287, ctime=1777502854443, mtime=1777502854443, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=287)) (connection.py:410, _read_response) 2026-04-29 22:47:56 [ 539 ] DEBUG : Sending request(xid=251): GetData(path='/test_snapshot_multinode_recover248', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:56 [ 539 ] DEBUG : Received response(xid=251): (b'somedata248', ZnodeStat(czxid=287, mzxid=287, ctime=1777502854443, mtime=1777502854443, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=287)) (connection.py:410, _read_response) 2026-04-29 22:47:56 [ 539 ] DEBUG : Sending request(xid=251): GetData(path='/test_snapshot_multinode_recover248', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:56 [ 539 ] DEBUG : Received response(xid=251): (b'somedata248', ZnodeStat(czxid=287, mzxid=287, ctime=1777502854443, mtime=1777502854443, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=287)) (connection.py:410, _read_response) 2026-04-29 22:47:56 [ 539 ] DEBUG : Sending request(xid=252): GetData(path='/test_snapshot_multinode_recover249', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:56 [ 539 ] DEBUG : Received response(xid=252): (b'somedata249', ZnodeStat(czxid=288, mzxid=288, ctime=1777502854459, mtime=1777502854459, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=288)) (connection.py:410, _read_response) 2026-04-29 22:47:56 [ 539 ] DEBUG : Sending request(xid=252): GetData(path='/test_snapshot_multinode_recover249', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:56 [ 539 ] DEBUG : Received response(xid=252): (b'somedata249', ZnodeStat(czxid=288, mzxid=288, ctime=1777502854459, mtime=1777502854459, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=288)) (connection.py:410, _read_response) 2026-04-29 22:47:56 [ 539 ] DEBUG : Sending request(xid=252): GetData(path='/test_snapshot_multinode_recover249', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:56 [ 539 ] DEBUG : Received response(xid=252): (b'somedata249', ZnodeStat(czxid=288, mzxid=288, ctime=1777502854459, mtime=1777502854459, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=288)) (connection.py:410, _read_response) 2026-04-29 22:47:56 [ 539 ] DEBUG : Sending request(xid=253): Exists(path='/test_snapshot_multinode_recover250', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:56 [ 539 ] DEBUG : Sending request(xid=253): Exists(path='/test_snapshot_multinode_recover250', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:56 [ 539 ] DEBUG : Sending request(xid=253): Exists(path='/test_snapshot_multinode_recover250', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:56 [ 539 ] DEBUG : Sending request(xid=254): GetData(path='/test_snapshot_multinode_recover251', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:56 [ 539 ] DEBUG : Received response(xid=254): (b'somedata251', ZnodeStat(czxid=290, mzxid=290, ctime=1777502854497, mtime=1777502854497, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=290)) (connection.py:410, _read_response) 2026-04-29 22:47:56 [ 539 ] DEBUG : Sending request(xid=254): GetData(path='/test_snapshot_multinode_recover251', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:56 [ 539 ] DEBUG : Received response(xid=254): (b'somedata251', ZnodeStat(czxid=290, mzxid=290, ctime=1777502854497, mtime=1777502854497, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=290)) (connection.py:410, _read_response) 2026-04-29 22:47:56 [ 539 ] DEBUG : Sending request(xid=254): GetData(path='/test_snapshot_multinode_recover251', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:56 [ 539 ] DEBUG : Received response(xid=254): (b'somedata251', ZnodeStat(czxid=290, mzxid=290, ctime=1777502854497, mtime=1777502854497, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=290)) (connection.py:410, _read_response) 2026-04-29 22:47:56 [ 539 ] DEBUG : Sending request(xid=255): GetData(path='/test_snapshot_multinode_recover252', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:56 [ 539 ] DEBUG : Received response(xid=255): (b'somedata252', ZnodeStat(czxid=291, mzxid=291, ctime=1777502854515, mtime=1777502854515, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=291)) (connection.py:410, _read_response) 2026-04-29 22:47:56 [ 539 ] DEBUG : Sending request(xid=255): GetData(path='/test_snapshot_multinode_recover252', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:56 [ 539 ] DEBUG : Received response(xid=255): (b'somedata252', ZnodeStat(czxid=291, mzxid=291, ctime=1777502854515, mtime=1777502854515, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=291)) (connection.py:410, _read_response) 2026-04-29 22:47:56 [ 539 ] DEBUG : Sending request(xid=255): GetData(path='/test_snapshot_multinode_recover252', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:56 [ 539 ] DEBUG : Received response(xid=255): (b'somedata252', ZnodeStat(czxid=291, mzxid=291, ctime=1777502854515, mtime=1777502854515, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=291)) (connection.py:410, _read_response) 2026-04-29 22:47:56 [ 539 ] DEBUG : Sending request(xid=256): GetData(path='/test_snapshot_multinode_recover253', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:56 [ 539 ] DEBUG : Received response(xid=256): (b'somedata253', ZnodeStat(czxid=292, mzxid=292, ctime=1777502854538, mtime=1777502854538, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=292)) (connection.py:410, _read_response) 2026-04-29 22:47:56 [ 539 ] DEBUG : Sending request(xid=256): GetData(path='/test_snapshot_multinode_recover253', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:56 [ 539 ] DEBUG : Received response(xid=256): (b'somedata253', ZnodeStat(czxid=292, mzxid=292, ctime=1777502854538, mtime=1777502854538, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=292)) (connection.py:410, _read_response) 2026-04-29 22:47:56 [ 539 ] DEBUG : Sending request(xid=256): GetData(path='/test_snapshot_multinode_recover253', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:56 [ 539 ] DEBUG : Received response(xid=256): (b'somedata253', ZnodeStat(czxid=292, mzxid=292, ctime=1777502854538, mtime=1777502854538, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=292)) (connection.py:410, _read_response) 2026-04-29 22:47:56 [ 539 ] DEBUG : Sending request(xid=257): GetData(path='/test_snapshot_multinode_recover254', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:56 [ 539 ] DEBUG : Received response(xid=257): (b'somedata254', ZnodeStat(czxid=293, mzxid=293, ctime=1777502854584, mtime=1777502854584, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=293)) (connection.py:410, _read_response) 2026-04-29 22:47:56 [ 539 ] DEBUG : Sending request(xid=257): GetData(path='/test_snapshot_multinode_recover254', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:56 [ 539 ] DEBUG : Received response(xid=257): (b'somedata254', ZnodeStat(czxid=293, mzxid=293, ctime=1777502854584, mtime=1777502854584, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=293)) (connection.py:410, _read_response) 2026-04-29 22:47:56 [ 539 ] DEBUG : Sending request(xid=257): GetData(path='/test_snapshot_multinode_recover254', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:56 [ 539 ] DEBUG : Received response(xid=257): (b'somedata254', ZnodeStat(czxid=293, mzxid=293, ctime=1777502854584, mtime=1777502854584, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=293)) (connection.py:410, _read_response) 2026-04-29 22:47:56 [ 539 ] DEBUG : Sending request(xid=258): GetData(path='/test_snapshot_multinode_recover255', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:56 [ 539 ] DEBUG : Received response(xid=258): (b'somedata255', ZnodeStat(czxid=294, mzxid=294, ctime=1777502854598, mtime=1777502854598, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=294)) (connection.py:410, _read_response) 2026-04-29 22:47:56 [ 539 ] DEBUG : Sending request(xid=258): GetData(path='/test_snapshot_multinode_recover255', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:56 [ 539 ] DEBUG : Received response(xid=258): (b'somedata255', ZnodeStat(czxid=294, mzxid=294, ctime=1777502854598, mtime=1777502854598, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=294)) (connection.py:410, _read_response) 2026-04-29 22:47:56 [ 539 ] DEBUG : Sending request(xid=258): GetData(path='/test_snapshot_multinode_recover255', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:56 [ 539 ] DEBUG : Received response(xid=258): (b'somedata255', ZnodeStat(czxid=294, mzxid=294, ctime=1777502854598, mtime=1777502854598, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=294)) (connection.py:410, _read_response) 2026-04-29 22:47:56 [ 539 ] DEBUG : Sending request(xid=259): GetData(path='/test_snapshot_multinode_recover256', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:56 [ 539 ] DEBUG : Received response(xid=259): (b'somedata256', ZnodeStat(czxid=295, mzxid=295, ctime=1777502854622, mtime=1777502854622, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=295)) (connection.py:410, _read_response) 2026-04-29 22:47:56 [ 539 ] DEBUG : Sending request(xid=259): GetData(path='/test_snapshot_multinode_recover256', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:56 [ 539 ] DEBUG : Received response(xid=259): (b'somedata256', ZnodeStat(czxid=295, mzxid=295, ctime=1777502854622, mtime=1777502854622, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=295)) (connection.py:410, _read_response) 2026-04-29 22:47:56 [ 539 ] DEBUG : Sending request(xid=259): GetData(path='/test_snapshot_multinode_recover256', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:56 [ 539 ] DEBUG : Received response(xid=259): (b'somedata256', ZnodeStat(czxid=295, mzxid=295, ctime=1777502854622, mtime=1777502854622, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=295)) (connection.py:410, _read_response) 2026-04-29 22:47:56 [ 539 ] DEBUG : Sending request(xid=260): GetData(path='/test_snapshot_multinode_recover257', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:56 [ 539 ] DEBUG : Received response(xid=260): (b'somedata257', ZnodeStat(czxid=296, mzxid=296, ctime=1777502854648, mtime=1777502854648, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=296)) (connection.py:410, _read_response) 2026-04-29 22:47:56 [ 539 ] DEBUG : Sending request(xid=260): GetData(path='/test_snapshot_multinode_recover257', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:56 [ 539 ] DEBUG : Received response(xid=260): (b'somedata257', ZnodeStat(czxid=296, mzxid=296, ctime=1777502854648, mtime=1777502854648, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=296)) (connection.py:410, _read_response) 2026-04-29 22:47:56 [ 539 ] DEBUG : Sending request(xid=260): GetData(path='/test_snapshot_multinode_recover257', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:56 [ 539 ] DEBUG : Received response(xid=260): (b'somedata257', ZnodeStat(czxid=296, mzxid=296, ctime=1777502854648, mtime=1777502854648, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=296)) (connection.py:410, _read_response) 2026-04-29 22:47:56 [ 539 ] DEBUG : Sending request(xid=261): GetData(path='/test_snapshot_multinode_recover258', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:56 [ 539 ] DEBUG : Received response(xid=261): (b'somedata258', ZnodeStat(czxid=297, mzxid=297, ctime=1777502854662, mtime=1777502854662, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=297)) (connection.py:410, _read_response) 2026-04-29 22:47:56 [ 539 ] DEBUG : Sending request(xid=261): GetData(path='/test_snapshot_multinode_recover258', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:56 [ 539 ] DEBUG : Received response(xid=261): (b'somedata258', ZnodeStat(czxid=297, mzxid=297, ctime=1777502854662, mtime=1777502854662, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=297)) (connection.py:410, _read_response) 2026-04-29 22:47:56 [ 539 ] DEBUG : Sending request(xid=261): GetData(path='/test_snapshot_multinode_recover258', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:56 [ 539 ] DEBUG : Received response(xid=261): (b'somedata258', ZnodeStat(czxid=297, mzxid=297, ctime=1777502854662, mtime=1777502854662, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=297)) (connection.py:410, _read_response) 2026-04-29 22:47:56 [ 539 ] DEBUG : Sending request(xid=262): GetData(path='/test_snapshot_multinode_recover259', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:56 [ 539 ] DEBUG : Received response(xid=262): (b'somedata259', ZnodeStat(czxid=298, mzxid=298, ctime=1777502854711, mtime=1777502854711, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=298)) (connection.py:410, _read_response) 2026-04-29 22:47:56 [ 539 ] DEBUG : Sending request(xid=262): GetData(path='/test_snapshot_multinode_recover259', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:56 [ 539 ] DEBUG : Received response(xid=262): (b'somedata259', ZnodeStat(czxid=298, mzxid=298, ctime=1777502854711, mtime=1777502854711, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=298)) (connection.py:410, _read_response) 2026-04-29 22:47:56 [ 539 ] DEBUG : Sending request(xid=262): GetData(path='/test_snapshot_multinode_recover259', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:56 [ 539 ] DEBUG : Received response(xid=262): (b'somedata259', ZnodeStat(czxid=298, mzxid=298, ctime=1777502854711, mtime=1777502854711, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=298)) (connection.py:410, _read_response) 2026-04-29 22:47:56 [ 539 ] DEBUG : Sending request(xid=263): Exists(path='/test_snapshot_multinode_recover260', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:56 [ 539 ] DEBUG : Sending request(xid=263): Exists(path='/test_snapshot_multinode_recover260', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:56 [ 539 ] DEBUG : Sending request(xid=263): Exists(path='/test_snapshot_multinode_recover260', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:56 [ 539 ] DEBUG : Sending request(xid=264): GetData(path='/test_snapshot_multinode_recover261', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:56 [ 539 ] DEBUG : Received response(xid=264): (b'somedata261', ZnodeStat(czxid=300, mzxid=300, ctime=1777502854775, mtime=1777502854775, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=300)) (connection.py:410, _read_response) 2026-04-29 22:47:56 [ 539 ] DEBUG : Sending request(xid=264): GetData(path='/test_snapshot_multinode_recover261', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:56 [ 539 ] DEBUG : Received response(xid=264): (b'somedata261', ZnodeStat(czxid=300, mzxid=300, ctime=1777502854775, mtime=1777502854775, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=300)) (connection.py:410, _read_response) 2026-04-29 22:47:56 [ 539 ] DEBUG : Sending request(xid=264): GetData(path='/test_snapshot_multinode_recover261', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:56 [ 539 ] DEBUG : Received response(xid=264): (b'somedata261', ZnodeStat(czxid=300, mzxid=300, ctime=1777502854775, mtime=1777502854775, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=300)) (connection.py:410, _read_response) 2026-04-29 22:47:56 [ 539 ] DEBUG : Sending request(xid=265): GetData(path='/test_snapshot_multinode_recover262', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:56 [ 539 ] DEBUG : Received response(xid=265): (b'somedata262', ZnodeStat(czxid=301, mzxid=301, ctime=1777502854812, mtime=1777502854812, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=301)) (connection.py:410, _read_response) 2026-04-29 22:47:56 [ 539 ] DEBUG : Sending request(xid=265): GetData(path='/test_snapshot_multinode_recover262', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:56 [ 539 ] DEBUG : Received response(xid=265): (b'somedata262', ZnodeStat(czxid=301, mzxid=301, ctime=1777502854812, mtime=1777502854812, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=301)) (connection.py:410, _read_response) 2026-04-29 22:47:56 [ 539 ] DEBUG : Sending request(xid=265): GetData(path='/test_snapshot_multinode_recover262', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:56 [ 539 ] DEBUG : Received response(xid=265): (b'somedata262', ZnodeStat(czxid=301, mzxid=301, ctime=1777502854812, mtime=1777502854812, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=301)) (connection.py:410, _read_response) 2026-04-29 22:47:56 [ 539 ] DEBUG : Sending request(xid=266): GetData(path='/test_snapshot_multinode_recover263', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:56 [ 539 ] DEBUG : Received response(xid=266): (b'somedata263', ZnodeStat(czxid=302, mzxid=302, ctime=1777502854843, mtime=1777502854843, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=302)) (connection.py:410, _read_response) 2026-04-29 22:47:56 [ 539 ] DEBUG : Sending request(xid=266): GetData(path='/test_snapshot_multinode_recover263', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:56 [ 539 ] DEBUG : Received response(xid=266): (b'somedata263', ZnodeStat(czxid=302, mzxid=302, ctime=1777502854843, mtime=1777502854843, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=302)) (connection.py:410, _read_response) 2026-04-29 22:47:56 [ 539 ] DEBUG : Sending request(xid=266): GetData(path='/test_snapshot_multinode_recover263', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:56 [ 539 ] DEBUG : Received response(xid=266): (b'somedata263', ZnodeStat(czxid=302, mzxid=302, ctime=1777502854843, mtime=1777502854843, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=302)) (connection.py:410, _read_response) 2026-04-29 22:47:56 [ 539 ] DEBUG : Sending request(xid=267): GetData(path='/test_snapshot_multinode_recover264', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:56 [ 539 ] DEBUG : Received response(xid=267): (b'somedata264', ZnodeStat(czxid=303, mzxid=303, ctime=1777502854859, mtime=1777502854859, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=303)) (connection.py:410, _read_response) 2026-04-29 22:47:56 [ 539 ] DEBUG : Sending request(xid=267): GetData(path='/test_snapshot_multinode_recover264', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:56 [ 539 ] DEBUG : Received response(xid=267): (b'somedata264', ZnodeStat(czxid=303, mzxid=303, ctime=1777502854859, mtime=1777502854859, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=303)) (connection.py:410, _read_response) 2026-04-29 22:47:56 [ 539 ] DEBUG : Sending request(xid=267): GetData(path='/test_snapshot_multinode_recover264', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:56 [ 539 ] DEBUG : Received response(xid=267): (b'somedata264', ZnodeStat(czxid=303, mzxid=303, ctime=1777502854859, mtime=1777502854859, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=303)) (connection.py:410, _read_response) 2026-04-29 22:47:56 [ 539 ] DEBUG : Sending request(xid=268): GetData(path='/test_snapshot_multinode_recover265', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:56 [ 539 ] DEBUG : Received response(xid=268): (b'somedata265', ZnodeStat(czxid=304, mzxid=304, ctime=1777502854883, mtime=1777502854883, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=304)) (connection.py:410, _read_response) 2026-04-29 22:47:56 [ 539 ] DEBUG : Sending request(xid=268): GetData(path='/test_snapshot_multinode_recover265', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:56 [ 539 ] DEBUG : Received response(xid=268): (b'somedata265', ZnodeStat(czxid=304, mzxid=304, ctime=1777502854883, mtime=1777502854883, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=304)) (connection.py:410, _read_response) 2026-04-29 22:47:56 [ 539 ] DEBUG : Sending request(xid=268): GetData(path='/test_snapshot_multinode_recover265', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:56 [ 539 ] DEBUG : Received response(xid=268): (b'somedata265', ZnodeStat(czxid=304, mzxid=304, ctime=1777502854883, mtime=1777502854883, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=304)) (connection.py:410, _read_response) 2026-04-29 22:47:56 [ 539 ] DEBUG : Sending request(xid=269): GetData(path='/test_snapshot_multinode_recover266', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:56 [ 539 ] DEBUG : Received response(xid=269): (b'somedata266', ZnodeStat(czxid=305, mzxid=305, ctime=1777502854898, mtime=1777502854898, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=305)) (connection.py:410, _read_response) 2026-04-29 22:47:56 [ 539 ] DEBUG : Sending request(xid=269): GetData(path='/test_snapshot_multinode_recover266', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:56 [ 539 ] DEBUG : Received response(xid=269): (b'somedata266', ZnodeStat(czxid=305, mzxid=305, ctime=1777502854898, mtime=1777502854898, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=305)) (connection.py:410, _read_response) 2026-04-29 22:47:56 [ 539 ] DEBUG : Sending request(xid=269): GetData(path='/test_snapshot_multinode_recover266', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:57 [ 539 ] DEBUG : Received response(xid=269): (b'somedata266', ZnodeStat(czxid=305, mzxid=305, ctime=1777502854898, mtime=1777502854898, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=305)) (connection.py:410, _read_response) 2026-04-29 22:47:57 [ 539 ] DEBUG : Sending request(xid=270): GetData(path='/test_snapshot_multinode_recover267', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:57 [ 539 ] DEBUG : Received response(xid=270): (b'somedata267', ZnodeStat(czxid=306, mzxid=306, ctime=1777502854916, mtime=1777502854916, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=306)) (connection.py:410, _read_response) 2026-04-29 22:47:57 [ 539 ] DEBUG : Sending request(xid=270): GetData(path='/test_snapshot_multinode_recover267', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:57 [ 539 ] DEBUG : Received response(xid=270): (b'somedata267', ZnodeStat(czxid=306, mzxid=306, ctime=1777502854916, mtime=1777502854916, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=306)) (connection.py:410, _read_response) 2026-04-29 22:47:57 [ 539 ] DEBUG : Sending request(xid=270): GetData(path='/test_snapshot_multinode_recover267', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:57 [ 539 ] DEBUG : Received response(xid=270): (b'somedata267', ZnodeStat(czxid=306, mzxid=306, ctime=1777502854916, mtime=1777502854916, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=306)) (connection.py:410, _read_response) 2026-04-29 22:47:57 [ 539 ] DEBUG : Sending request(xid=271): GetData(path='/test_snapshot_multinode_recover268', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:57 [ 539 ] DEBUG : Received response(xid=271): (b'somedata268', ZnodeStat(czxid=307, mzxid=307, ctime=1777502854944, mtime=1777502854944, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=307)) (connection.py:410, _read_response) 2026-04-29 22:47:57 [ 539 ] DEBUG : Sending request(xid=271): GetData(path='/test_snapshot_multinode_recover268', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:57 [ 539 ] DEBUG : Received response(xid=271): (b'somedata268', ZnodeStat(czxid=307, mzxid=307, ctime=1777502854944, mtime=1777502854944, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=307)) (connection.py:410, _read_response) 2026-04-29 22:47:57 [ 539 ] DEBUG : Sending request(xid=271): GetData(path='/test_snapshot_multinode_recover268', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:57 [ 539 ] DEBUG : Received response(xid=271): (b'somedata268', ZnodeStat(czxid=307, mzxid=307, ctime=1777502854944, mtime=1777502854944, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=307)) (connection.py:410, _read_response) 2026-04-29 22:47:57 [ 539 ] DEBUG : Sending request(xid=272): GetData(path='/test_snapshot_multinode_recover269', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:57 [ 539 ] DEBUG : Received response(xid=272): (b'somedata269', ZnodeStat(czxid=308, mzxid=308, ctime=1777502854978, mtime=1777502854978, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=308)) (connection.py:410, _read_response) 2026-04-29 22:47:57 [ 539 ] DEBUG : Sending request(xid=272): GetData(path='/test_snapshot_multinode_recover269', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:57 [ 539 ] DEBUG : Received response(xid=272): (b'somedata269', ZnodeStat(czxid=308, mzxid=308, ctime=1777502854978, mtime=1777502854978, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=308)) (connection.py:410, _read_response) 2026-04-29 22:47:57 [ 539 ] DEBUG : Sending request(xid=272): GetData(path='/test_snapshot_multinode_recover269', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:57 [ 539 ] DEBUG : Received response(xid=272): (b'somedata269', ZnodeStat(czxid=308, mzxid=308, ctime=1777502854978, mtime=1777502854978, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=308)) (connection.py:410, _read_response) 2026-04-29 22:47:57 [ 539 ] DEBUG : Sending request(xid=273): Exists(path='/test_snapshot_multinode_recover270', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:57 [ 539 ] DEBUG : Sending request(xid=273): Exists(path='/test_snapshot_multinode_recover270', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:57 [ 539 ] DEBUG : Sending request(xid=273): Exists(path='/test_snapshot_multinode_recover270', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:57 [ 539 ] DEBUG : Sending request(xid=274): GetData(path='/test_snapshot_multinode_recover271', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:57 [ 539 ] DEBUG : Received response(xid=274): (b'somedata271', ZnodeStat(czxid=310, mzxid=310, ctime=1777502855040, mtime=1777502855040, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=310)) (connection.py:410, _read_response) 2026-04-29 22:47:57 [ 539 ] DEBUG : Sending request(xid=274): GetData(path='/test_snapshot_multinode_recover271', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:57 [ 539 ] DEBUG : Received response(xid=274): (b'somedata271', ZnodeStat(czxid=310, mzxid=310, ctime=1777502855040, mtime=1777502855040, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=310)) (connection.py:410, _read_response) 2026-04-29 22:47:57 [ 539 ] DEBUG : Sending request(xid=274): GetData(path='/test_snapshot_multinode_recover271', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:57 [ 539 ] DEBUG : Received response(xid=274): (b'somedata271', ZnodeStat(czxid=310, mzxid=310, ctime=1777502855040, mtime=1777502855040, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=310)) (connection.py:410, _read_response) 2026-04-29 22:47:57 [ 539 ] DEBUG : Sending request(xid=275): GetData(path='/test_snapshot_multinode_recover272', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:57 [ 539 ] DEBUG : Received response(xid=275): (b'somedata272', ZnodeStat(czxid=311, mzxid=311, ctime=1777502855065, mtime=1777502855065, version=0, cversion=0, aversion=0, ephemeralOwner=0, dataLength=11, numChildren=0, pzxid=311)) (connection.py:410, _read_response) 2026-04-29 22:47:57 [ 539 ] DEBUG : Sending request(xid=275): GetData(path='/test_snapshot_multinode_recover272', watcher=None) (connection.py:312, _submit) 2026-04-29 22:47:57 [ 539 ] WARNING : Connection dropped: socket connection broken (connection.py:622, _connect_attempt) 2026-04-29 22:47:57 [ 539 ] WARNING : Transition to CONNECTING (connection.py:626, _connect_attempt) 2026-04-29 22:47:57 [ 539 ] INFO : Zookeeper connection lost (client.py:543, _session_callback) 2026-04-29 22:47:57 [ 539 ] DEBUG : Sending request(xid=276): Close() (connection.py:312, _submit) 2026-04-29 22:47:57 [ 539 ] WARNING : Connection dropped: socket connection broken (connection.py:622, _connect_attempt) 2026-04-29 22:47:57 [ 539 ] WARNING : Transition to CONNECTING (connection.py:626, _connect_attempt) 2026-04-29 22:47:57 [ 539 ] INFO : Zookeeper connection lost (client.py:543, _session_callback) 2026-04-29 22:47:57 [ 539 ] WARNING : Failed connecting to Zookeeper within the connection retry policy. (connection.py:515, zk_loop) 2026-04-29 22:47:57 [ 539 ] INFO : Zookeeper session closed, state: CLOSED (client.py:537, _session_callback) 2026-04-29 22:47:57 [ 539 ] WARNING : Failed connecting to Zookeeper within the connection retry policy. (connection.py:515, zk_loop) 2026-04-29 22:47:57 [ 539 ] INFO : Zookeeper session closed, state: CLOSED (client.py:537, _session_callback) 2026-04-29 22:47:57 [ 539 ] DEBUG : Sending request(xid=275): Close() (connection.py:312, _submit) 2026-04-29 22:47:57 [ 539 ] WARNING : Connection dropped: socket connection broken (connection.py:622, _connect_attempt) 2026-04-29 22:47:57 [ 539 ] WARNING : Transition to CONNECTING (connection.py:626, _connect_attempt) 2026-04-29 22:47:57 [ 539 ] INFO : Zookeeper connection lost (client.py:543, _session_callback) 2026-04-29 22:47:57 [ 539 ] WARNING : Failed connecting to Zookeeper within the connection retry policy. (connection.py:515, zk_loop) 2026-04-29 22:47:57 [ 539 ] INFO : Zookeeper session closed, state: CLOSED (client.py:537, _session_callback) ---------------------------- Captured log teardown ----------------------------- 2026-04-29 22:47:59 [ 539 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_keeper_restore_from_snapshot/_instances_0_gw9/.env', '--project-name', 'roottestkeeperrestorefromsnapshot_gw9', '--file', '/ClickHouse/tests/integration/test_keeper_restore_from_snapshot/_instances_0_gw9/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_keeper_restore_from_snapshot/_instances_0_gw9/node2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_keeper_restore_from_snapshot/_instances_0_gw9/node3/docker-compose.yml', 'stop', '--timeout', '20'] (cluster.py:113, run_and_check) 2026-04-29 22:48:03 [ 539 ] DEBUG : Stderr:Stopping roottestkeeperrestorefromsnapshot_gw9_node1_1 ... (cluster.py:123, run_and_check) 2026-04-29 22:48:03 [ 539 ] DEBUG : Stderr:Stopping roottestkeeperrestorefromsnapshot_gw9_node3_1 ... (cluster.py:123, run_and_check) 2026-04-29 22:48:03 [ 539 ] DEBUG : Stderr:Stopping roottestkeeperrestorefromsnapshot_gw9_node2_1 ... (cluster.py:123, run_and_check) 2026-04-29 22:48:03 [ 539 ] DEBUG : Stderr:Stopping roottestkeeperrestorefromsnapshot_gw9_node3_1 ... done (cluster.py:123, run_and_check) 2026-04-29 22:48:03 [ 539 ] DEBUG : Stderr:Stopping roottestkeeperrestorefromsnapshot_gw9_node1_1 ... done (cluster.py:123, run_and_check) 2026-04-29 22:48:03 [ 539 ] DEBUG : Stderr:Stopping roottestkeeperrestorefromsnapshot_gw9_node2_1 ... done (cluster.py:123, run_and_check) 2026-04-29 22:48:03 [ 539 ] DEBUG : Command:['bash', '-c', '[ -f /ClickHouse/tests/integration/test_keeper_restore_from_snapshot/_instances_0_gw9/node1/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_keeper_restore_from_snapshot/_instances_0_gw9/node1/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true'] (cluster.py:113, run_and_check) 2026-04-29 22:48:03 [ 539 ] DEBUG : Command:['bash', '-c', '[ -f /ClickHouse/tests/integration/test_keeper_restore_from_snapshot/_instances_0_gw9/node2/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_keeper_restore_from_snapshot/_instances_0_gw9/node2/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true'] (cluster.py:113, run_and_check) 2026-04-29 22:48:03 [ 539 ] DEBUG : Command:['bash', '-c', '[ -f /ClickHouse/tests/integration/test_keeper_restore_from_snapshot/_instances_0_gw9/node3/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_keeper_restore_from_snapshot/_instances_0_gw9/node3/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true'] (cluster.py:113, run_and_check) 2026-04-29 22:48:03 [ 539 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_keeper_restore_from_snapshot/_instances_0_gw9/.env', '--project-name', 'roottestkeeperrestorefromsnapshot_gw9', '--file', '/ClickHouse/tests/integration/test_keeper_restore_from_snapshot/_instances_0_gw9/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_keeper_restore_from_snapshot/_instances_0_gw9/node2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_keeper_restore_from_snapshot/_instances_0_gw9/node3/docker-compose.yml', 'down', '--volumes'] (cluster.py:113, run_and_check) 2026-04-29 22:48:06 [ 539 ] DEBUG : Stderr:Removing roottestkeeperrestorefromsnapshot_gw9_node1_1 ... (cluster.py:123, run_and_check) 2026-04-29 22:48:06 [ 539 ] DEBUG : Stderr:Removing roottestkeeperrestorefromsnapshot_gw9_node3_1 ... (cluster.py:123, run_and_check) 2026-04-29 22:48:06 [ 539 ] DEBUG : Stderr:Removing roottestkeeperrestorefromsnapshot_gw9_node2_1 ... (cluster.py:123, run_and_check) 2026-04-29 22:48:06 [ 539 ] DEBUG : Stderr:Removing roottestkeeperrestorefromsnapshot_gw9_node1_1 ... done (cluster.py:123, run_and_check) 2026-04-29 22:48:06 [ 539 ] DEBUG : Stderr:Removing roottestkeeperrestorefromsnapshot_gw9_node3_1 ... done (cluster.py:123, run_and_check) 2026-04-29 22:48:06 [ 539 ] DEBUG : Stderr:Removing roottestkeeperrestorefromsnapshot_gw9_node2_1 ... done (cluster.py:123, run_and_check) 2026-04-29 22:48:06 [ 539 ] DEBUG : Stderr:Removing network roottestkeeperrestorefromsnapshot_gw9_default (cluster.py:123, run_and_check) 2026-04-29 22:48:06 [ 539 ] DEBUG : Cleanup called (cluster.py:876, cleanup) 2026-04-29 22:48:06 [ 539 ] DEBUG : Docker networks for project roottestkeeperrestorefromsnapshot_gw9 are NETWORK ID NAME DRIVER SCOPE (cluster.py:855, print_all_docker_pieces) 2026-04-29 22:48:06 [ 539 ] DEBUG : Docker containers for project roottestkeeperrestorefromsnapshot_gw9 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:863, print_all_docker_pieces) 2026-04-29 22:48:06 [ 539 ] DEBUG : Docker volumes for project roottestkeeperrestorefromsnapshot_gw9 are DRIVER VOLUME NAME (cluster.py:871, print_all_docker_pieces) 2026-04-29 22:48:06 [ 539 ] DEBUG : Command:docker container list --all --filter name='^/roottestkeeperrestorefromsnapshot_gw9_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-04-29 22:48:06 [ 539 ] DEBUG : Unstopped containers: {} (cluster.py:890, cleanup) 2026-04-29 22:48:06 [ 539 ] DEBUG : No running containers for project: roottestkeeperrestorefromsnapshot_gw9 (cluster.py:904, cleanup) 2026-04-29 22:48:06 [ 539 ] DEBUG : Trying to prune unused networks... (cluster.py:910, cleanup) 2026-04-29 22:48:06 [ 539 ] DEBUG : Trying to prune unused images... (cluster.py:926, cleanup) 2026-04-29 22:48:06 [ 539 ] DEBUG : Command:['docker', 'image', 'prune', '-f'] (cluster.py:113, run_and_check) 2026-04-29 22:48:06 [ 539 ] DEBUG : Stdout:Total reclaimed space: 0B (cluster.py:121, run_and_check) 2026-04-29 22:48:06 [ 539 ] DEBUG : Images pruned (cluster.py:929, cleanup) 2026-04-29 22:48:06 [ 539 ] DEBUG : Trying to prune unused volumes... (cluster.py:935, cleanup) 2026-04-29 22:48:06 [ 539 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-04-29 22:48:06 [ 539 ] DEBUG : Stdout:8 (cluster.py:121, run_and_check) ============================== slowest durations =============================== 294.85s call test_lost_part_during_startup/test.py::test_lost_part_during_startup 289.61s call test_kafka_bad_messages/test.py::test_bad_messages_parsing_stream 264.52s call test_materialized_mysql_database/test.py::test_binlog_client 252.71s call test_keeper_memory_soft_limit/test.py::test_soft_limit_create 208.15s setup test_kafka_bad_messages/test.py::test_bad_messages_parsing_exception 157.87s call test_keeper_back_to_back/test.py::test_random_requests 149.08s setup test_insert_into_distributed/test.py::test_inserts_local 102.53s setup test_ldap_external_user_directory/test.py::test_authentication_fail 98.05s setup test_materialized_mysql_database/test.py::test_binlog_client 95.07s setup test_https_s3_table_function_with_http_proxy_no_tunneling/test.py::test_s3_with_https_env_proxy 79.89s call test_keeper_three_nodes_start/test.py::test_smoke 79.02s setup test_mask_sensitive_info/test.py::test_backup_table 71.08s call test_interserver_dns_retires/test.py::test_query 64.92s call test_mask_sensitive_info/test.py::test_table_functions 64.20s call test_materialized_mysql_database/test.py::test_create_database_without_mysql_connection 63.71s setup test_keeper_back_to_back/test.py::test_concurrent_watches 61.43s setup test_keeper_reconfig_replace_leader_in_one_command/test.py::test_reconfig_replace_leader_in_one_command 58.08s setup test_lost_part_during_startup/test.py::test_lost_part_during_startup 57.43s setup test_keeper_reconfig_remove_many/test.py::test_reconfig_remove_2_and_leader 57.41s setup test_keeper_client/test.py::test_base_commands 56.88s setup test_jdbc_bridge/test.py::test_jdbc_delete 56.82s setup test_intersecting_parts/test.py::test_intersect_parts_when_restart 56.44s setup test_keeper_broken_logs/test.py::test_single_node_broken_log 54.99s setup test_keeper_snapshot_on_exit/test.py::test_snapshot_on_exit 53.80s setup test_logs_level/test.py::test_check_client_logs_level 53.45s setup test_keeper_multinode_simple/test.py::test_follower_restart 52.93s setup test_grpc_protocol/test.py::test_output_format 52.36s setup test_insert_into_distributed_sync_async/test.py::test_async_inserts_into_local_shard 52.27s setup test_keeper_reconfig_remove/test.py::test_reconfig_remove_followers_from_3 52.05s setup test_keeper_nodes_add/test.py::test_nodes_add 51.77s setup test_log_levels_update/test.py::test_log_levels_update 49.38s setup test_keeper_persistent_log_multinode/test.py::test_restart_multinode 49.09s setup test_keeper_memory_soft_limit/test.py::test_soft_limit_create 48.39s call test_keeper_snapshot_on_exit/test.py::test_snapshot_on_exit 48.33s call test_keeper_nodes_add/test.py::test_nodes_add 47.57s setup test_lazy_database/test.py::test_drop_table[0-default-False-Log] 47.55s setup test_keeper_restore_from_snapshot/test.py::test_recover_from_snapshot 45.61s setup test_join_set_family_s3/test.py::test_join_s3 44.43s call test_keeper_reconfig_replace_leader_in_one_command/test.py::test_reconfig_replace_leader_in_one_command 34.60s call test_keeper_reconfig_remove_many/test.py::test_reconfig_remove_2_and_leader 33.50s teardown test_https_s3_table_function_with_http_proxy_no_tunneling/test.py::test_s3_with_https_remote_proxy 31.56s teardown test_join_set_family_s3/test.py::test_set_s3 31.30s call test_keeper_restore_from_snapshot/test.py::test_recover_from_snapshot 29.62s call test_keeper_back_to_back/test.py::test_concurrent_watches 28.37s teardown test_lazy_database/test.py::test_drop_table[4-s3-True-Log] 27.41s call test_keeper_persistent_log_multinode/test.py::test_restart_multinode 25.92s teardown test_jdbc_bridge/test.py::test_jdbc_update 23.52s call test_materialized_mysql_database/test.py::test_clickhouse_killed_while_insert_8_0 23.17s teardown test_kafka_bad_messages/test.py::test_bad_messages_to_mv 23.09s call test_mask_sensitive_info/test.py::test_create_table 20.39s call test_materialized_mysql_database/test.py::test_clickhouse_killed_while_insert_5_7 20.03s teardown test_keeper_reconfig_remove/test.py::test_reconfig_remove_followers_from_3 19.21s teardown test_keeper_reconfig_remove_many/test.py::test_reconfig_remove_2_and_leader 18.44s teardown test_keeper_reconfig_replace_leader_in_one_command/test.py::test_reconfig_replace_leader_in_one_command 17.29s teardown test_insert_into_distributed/test.py::test_table_function 16.73s call test_keeper_broken_logs/test.py::test_single_node_broken_log 16.38s call test_kafka_bad_messages/test.py::test_bad_messages_to_mv 15.94s teardown test_materialized_mysql_database/test.py::test_default_values 15.79s teardown test_mask_sensitive_info/test.py::test_table_functions 14.22s call test_https_s3_table_function_with_http_proxy_no_tunneling/test.py::test_s3_with_https_env_proxy 13.90s teardown test_keeper_back_to_back/test.py::test_watchers 13.65s call test_https_s3_table_function_with_http_proxy_no_tunneling/test.py::test_s3_with_https_remote_proxy 13.49s teardown test_intersecting_parts/test.py::test_intersect_parts_when_restart 13.11s call test_keeper_reconfig_remove/test.py::test_reconfig_remove_followers_from_3 12.82s call test_https_s3_table_function_with_http_proxy_no_tunneling/test.py::test_s3_with_https_proxy_list 12.61s call test_keeper_back_to_back/test.py::test_watchers 12.24s teardown test_keeper_memory_soft_limit/test.py::test_soft_limit_create 11.77s call test_join_set_family_s3/test.py::test_join_s3 11.31s teardown test_keeper_nodes_add/test.py::test_nodes_add 11.22s teardown test_log_levels_update/test.py::test_log_levels_update 10.98s teardown test_logs_level/test.py::test_check_client_logs_level 9.45s teardown test_insert_into_distributed_sync_async/test.py::test_insertion_without_sync_ignores_timeout 9.35s call test_join_set_family_s3/test.py::test_set_s3 9.31s teardown test_keeper_broken_logs/test.py::test_single_node_broken_log 9.25s teardown test_ldap_external_user_directory/test.py::test_role_mapping 9.04s call test_jdbc_bridge/test.py::test_jdbc_delete 8.94s teardown test_keeper_restore_from_snapshot/test.py::test_recover_from_snapshot 8.36s call test_mask_sensitive_info/test.py::test_encryption_functions 8.23s call test_grpc_protocol/test.py::test_restart 8.22s teardown test_keeper_client/test.py::test_set_without_version 8.15s teardown test_keeper_persistent_log_multinode/test.py::test_restart_multinode 7.12s call test_kafka_bad_messages/test.py::test_bad_messages_parsing_exception 7.09s teardown test_keeper_multinode_simple/test.py::test_watch_on_follower 7.02s teardown test_keeper_snapshot_on_exit/test.py::test_snapshot_on_exit 6.91s teardown test_lost_part_during_startup/test.py::test_lost_part_during_startup 6.53s call test_log_levels_update/test.py::test_log_levels_update 6.45s teardown test_grpc_protocol/test.py::test_transport_compression 5.66s call test_lazy_database/test.py::test_drop_table[4-s3-True-Log] 5.35s call test_lazy_database/test.py::test_drop_table[4-default-False-Log] 4.74s call test_keeper_back_to_back/test.py::test_stats 4.39s call test_insert_into_distributed/test.py::test_prefer_localhost_replica 3.99s call test_mask_sensitive_info/test.py::test_table_function_ways_to_call 3.89s call test_mask_sensitive_info/test.py::test_create_alter_user 3.69s call test_keeper_multinode_simple/test.py::test_follower_restart 3.60s call test_mask_sensitive_info/test.py::test_backup_to_s3 3.59s call test_intersecting_parts/test.py::test_intersect_parts_when_restart 3.57s call test_keeper_multinode_simple/test.py::test_watch_on_follower 3.41s call test_ldap_external_user_directory/test.py::test_role_mapping 3.35s call test_mask_sensitive_info/test.py::test_on_cluster 2.98s call test_mask_sensitive_info/test.py::test_create_database 2.71s call test_keeper_multinode_simple/test.py::test_simple_replicated_table 2.46s call test_ldap_external_user_directory/test.py::test_push_role_to_other_nodes 2.19s teardown test_materialized_mysql_database/test.py::test_binlog_client 2.15s call test_insert_into_distributed_sync_async/test.py::test_insertion_sync_fails_with_timeout 2.00s call test_grpc_protocol/test.py::test_simultaneous_queries_multiple_channels 1.84s call test_mask_sensitive_info/test.py::test_create_dictionary 1.81s call test_insert_into_distributed_sync_async/test.py::test_insertion_sync 1.74s call test_materialized_mysql_database/test.py::test_default_values 1.73s call test_lazy_database/test.py::test_drop_table[0-default-False-Log] 1.73s call test_keeper_back_to_back/test.py::test_end_of_watches_session 1.67s call test_materialized_mysql_database/test.py::test_create_table_as_select 1.56s call test_insert_into_distributed_sync_async/test.py::test_insertion_without_sync_ignores_timeout 1.54s call test_insert_into_distributed_sync_async/test.py::test_async_inserts_into_local_shard 1.52s call test_grpc_protocol/test.py::test_simultaneous_queries_same_channel 1.49s call test_keeper_back_to_back/test.py::test_sequential_nodes 1.31s call test_lazy_database/test.py::test_drop_table[0-s3-True-Log] 1.26s call test_grpc_protocol/test.py::test_progress 1.19s call test_ldap_external_user_directory/test.py::test_remote_query_user_does_not_exist_locally 1.04s call test_insert_into_distributed_sync_async/test.py::test_insertion_sync_with_disabled_timeout 0.95s call test_insert_into_distributed/test.py::test_inserts_single_replica_internal_replication 0.95s call test_insert_into_distributed/test.py::test_inserts_local 0.90s call test_insert_into_distributed/test.py::test_inserts_low_cardinality 0.86s call test_jdbc_bridge/test.py::test_jdbc_insert 0.77s call test_jdbc_bridge/test.py::test_jdbc_update 0.66s call test_jdbc_bridge/test.py::test_jdbc_distributed_query 0.65s call test_mask_sensitive_info/test.py::test_backup_table 0.64s call test_insert_into_distributed/test.py::test_inserts_single_replica_no_internal_replication 0.56s call test_insert_into_distributed/test.py::test_table_function 0.49s call test_keeper_multinode_simple/test.py::test_read_write_multinode 0.47s call test_jdbc_bridge/test.py::test_jdbc_query 0.46s call test_keeper_back_to_back/test.py::test_end_of_session 0.45s call test_jdbc_bridge/test.py::test_jdbc_table_engine 0.42s call test_keeper_back_to_back/test.py::test_simple_commands 0.35s call test_insert_into_distributed/test.py::test_inserts_single_replica_local_internal_replication 0.34s call test_logs_level/test.py::test_check_client_logs_level 0.33s call test_keeper_back_to_back/test.py::test_multitransactions 0.28s teardown test_grpc_protocol/test.py::test_totals_and_extremes 0.24s call test_ldap_external_user_directory/test.py::test_authentication_fail 0.19s teardown test_grpc_protocol/test.py::test_simultaneous_queries_same_channel 0.18s call test_ldap_external_user_directory/test.py::test_authentication_pass 0.13s teardown test_keeper_back_to_back/test.py::test_random_requests 0.13s teardown test_grpc_protocol/test.py::test_session_temp_tables 0.13s teardown test_grpc_protocol/test.py::test_output_format 0.12s teardown test_grpc_protocol/test.py::test_restart 0.12s teardown test_grpc_protocol/test.py::test_progress 0.12s teardown test_grpc_protocol/test.py::test_simultaneous_queries_multiple_channels 0.12s teardown test_grpc_protocol/test.py::test_session_settings 0.12s teardown test_grpc_protocol/test.py::test_select_one 0.11s call test_keeper_client/test.py::test_delete_stale_backups 0.11s call test_keeper_client/test.py::test_big_family 0.10s teardown test_keeper_back_to_back/test.py::test_sequential_nodes 0.10s call test_grpc_protocol/test.py::test_totals_and_extremes 0.10s call test_keeper_client/test.py::test_find_super_nodes 0.10s call test_keeper_client/test.py::test_get_all_children_number 0.09s setup test_keeper_client/test.py::test_set_without_version 0.08s setup test_keeper_client/test.py::test_set_with_version 0.08s call test_keeper_client/test.py::test_set_with_version 0.08s call test_grpc_protocol/test.py::test_transport_compression 0.07s setup test_keeper_client/test.py::test_rm_without_version 0.07s setup test_keeper_client/test.py::test_four_letter_word_commands 0.06s setup test_keeper_client/test.py::test_get_all_children_number 0.06s setup test_keeper_client/test.py::test_big_family 0.06s setup test_keeper_client/test.py::test_rm_with_version 0.06s setup test_keeper_client/test.py::test_find_super_nodes 0.06s setup test_keeper_client/test.py::test_delete_stale_backups 0.05s setup test_keeper_client/test.py::test_quoted_argument_parsing 0.05s call test_keeper_client/test.py::test_quoted_argument_parsing 0.04s call test_grpc_protocol/test.py::test_session_temp_tables 0.04s call test_grpc_protocol/test.py::test_session_settings 0.03s call test_keeper_client/test.py::test_set_without_version 0.03s call test_grpc_protocol/test.py::test_output_format 0.03s call test_keeper_client/test.py::test_rm_with_version 0.03s teardown test_keeper_client/test.py::test_set_with_version 0.03s teardown test_keeper_back_to_back/test.py::test_concurrent_watches 0.03s call test_keeper_client/test.py::test_base_commands 0.02s teardown test_keeper_client/test.py::test_rm_without_version 0.02s teardown test_keeper_client/test.py::test_four_letter_word_commands 0.02s call test_keeper_client/test.py::test_rm_without_version 0.02s teardown test_keeper_client/test.py::test_delete_stale_backups 0.02s teardown test_keeper_client/test.py::test_base_commands 0.02s teardown test_keeper_three_nodes_start/test.py::test_smoke 0.02s teardown test_keeper_client/test.py::test_quoted_argument_parsing 0.02s teardown test_keeper_client/test.py::test_big_family 0.02s teardown test_keeper_client/test.py::test_rm_with_version 0.01s teardown test_kafka_bad_messages/test.py::test_bad_messages_parsing_stream 0.01s setup test_jdbc_bridge/test.py::test_jdbc_insert 0.01s teardown test_keeper_client/test.py::test_get_all_children_number 0.01s teardown test_keeper_client/test.py::test_find_super_nodes 0.01s teardown test_lazy_database/test.py::test_drop_table[0-default-False-Log] 0.01s teardown test_interserver_dns_retires/test.py::test_query 0.01s setup test_keeper_back_to_back/test.py::test_stats 0.01s teardown test_mask_sensitive_info/test.py::test_create_alter_user 0.01s setup test_materialized_mysql_database/test.py::test_default_values 0.01s call test_grpc_protocol/test.py::test_select_one 0.01s teardown test_join_set_family_s3/test.py::test_join_s3 0.01s call test_keeper_client/test.py::test_four_letter_word_commands 0.01s teardown test_keeper_multinode_simple/test.py::test_simple_replicated_table 0.01s setup test_kafka_bad_messages/test.py::test_bad_messages_to_mv 0.01s teardown test_materialized_mysql_database/test.py::test_create_table_as_select 0.01s teardown test_insert_into_distributed/test.py::test_inserts_local 0.00s teardown test_keeper_back_to_back/test.py::test_stats 0.00s setup test_keeper_back_to_back/test.py::test_watchers 0.00s setup test_keeper_three_nodes_start/test.py::test_smoke 0.00s setup test_keeper_multinode_simple/test.py::test_read_write_multinode 0.00s teardown test_materialized_mysql_database/test.py::test_clickhouse_killed_while_insert_5_7 0.00s teardown test_kafka_bad_messages/test.py::test_bad_messages_parsing_exception 0.00s setup test_ldap_external_user_directory/test.py::test_role_mapping 0.00s teardown test_insert_into_distributed_sync_async/test.py::test_insertion_sync_fails_with_timeout 0.00s setup test_insert_into_distributed_sync_async/test.py::test_insertion_sync 0.00s teardown test_https_s3_table_function_with_http_proxy_no_tunneling/test.py::test_s3_with_https_env_proxy 0.00s setup test_grpc_protocol/test.py::test_select_one 0.00s teardown test_mask_sensitive_info/test.py::test_backup_table 0.00s setup test_materialized_mysql_database/test.py::test_create_table_as_select 0.00s teardown test_insert_into_distributed/test.py::test_inserts_low_cardinality 0.00s teardown test_keeper_back_to_back/test.py::test_simple_commands 0.00s teardown test_mask_sensitive_info/test.py::test_backup_to_s3 0.00s setup test_insert_into_distributed/test.py::test_inserts_single_replica_internal_replication 0.00s teardown test_materialized_mysql_database/test.py::test_create_database_without_mysql_connection 0.00s teardown test_keeper_back_to_back/test.py::test_end_of_watches_session 0.00s setup test_grpc_protocol/test.py::test_totals_and_extremes 0.00s setup test_materialized_mysql_database/test.py::test_clickhouse_killed_while_insert_5_7 0.00s setup test_mask_sensitive_info/test.py::test_encryption_functions 0.00s teardown test_insert_into_distributed/test.py::test_inserts_single_replica_no_internal_replication 0.00s teardown test_ldap_external_user_directory/test.py::test_push_role_to_other_nodes 0.00s teardown test_jdbc_bridge/test.py::test_jdbc_delete 0.00s setup test_keeper_back_to_back/test.py::test_simple_commands 0.00s setup test_mask_sensitive_info/test.py::test_create_alter_user 0.00s teardown test_jdbc_bridge/test.py::test_jdbc_table_engine 0.00s setup test_join_set_family_s3/test.py::test_set_s3 0.00s setup test_insert_into_distributed/test.py::test_inserts_single_replica_no_internal_replication 0.00s teardown test_lazy_database/test.py::test_drop_table[4-default-False-Log] 0.00s setup test_mask_sensitive_info/test.py::test_table_function_ways_to_call 0.00s teardown test_ldap_external_user_directory/test.py::test_authentication_fail 0.00s setup test_lazy_database/test.py::test_drop_table[4-default-False-Log] 0.00s setup test_https_s3_table_function_with_http_proxy_no_tunneling/test.py::test_s3_with_https_proxy_list 0.00s setup test_materialized_mysql_database/test.py::test_clickhouse_killed_while_insert_8_0 0.00s setup test_lazy_database/test.py::test_drop_table[4-s3-True-Log] 0.00s teardown test_mask_sensitive_info/test.py::test_create_dictionary 0.00s teardown test_materialized_mysql_database/test.py::test_clickhouse_killed_while_insert_8_0 0.00s setup test_interserver_dns_retires/test.py::test_query 0.00s teardown test_keeper_back_to_back/test.py::test_multitransactions 0.00s teardown test_keeper_multinode_simple/test.py::test_read_write_multinode 0.00s setup test_grpc_protocol/test.py::test_simultaneous_queries_same_channel 0.00s setup test_jdbc_bridge/test.py::test_jdbc_update 0.00s setup test_mask_sensitive_info/test.py::test_backup_to_s3 0.00s setup test_jdbc_bridge/test.py::test_jdbc_table_engine 0.00s teardown test_mask_sensitive_info/test.py::test_create_table 0.00s setup test_lazy_database/test.py::test_drop_table[0-s3-True-Log] 0.00s teardown test_insert_into_distributed_sync_async/test.py::test_async_inserts_into_local_shard 0.00s setup test_insert_into_distributed/test.py::test_inserts_low_cardinality 0.00s setup test_kafka_bad_messages/test.py::test_bad_messages_parsing_stream 0.00s setup test_mask_sensitive_info/test.py::test_create_dictionary 0.00s setup test_keeper_back_to_back/test.py::test_multitransactions 0.00s setup test_grpc_protocol/test.py::test_progress 0.00s teardown test_mask_sensitive_info/test.py::test_table_function_ways_to_call 0.00s setup test_grpc_protocol/test.py::test_restart 0.00s setup test_insert_into_distributed/test.py::test_prefer_localhost_replica 0.00s teardown test_keeper_back_to_back/test.py::test_end_of_session 0.00s setup test_insert_into_distributed/test.py::test_table_function 0.00s setup test_mask_sensitive_info/test.py::test_create_table 0.00s setup test_grpc_protocol/test.py::test_transport_compression 0.00s teardown test_https_s3_table_function_with_http_proxy_no_tunneling/test.py::test_s3_with_https_proxy_list 0.00s teardown test_insert_into_distributed/test.py::test_inserts_single_replica_local_internal_replication 0.00s teardown test_jdbc_bridge/test.py::test_jdbc_query 0.00s setup test_ldap_external_user_directory/test.py::test_remote_query_user_does_not_exist_locally 0.00s setup test_keeper_multinode_simple/test.py::test_watch_on_follower 0.00s setup test_mask_sensitive_info/test.py::test_create_database 0.00s setup test_insert_into_distributed_sync_async/test.py::test_insertion_sync_with_disabled_timeout 0.00s setup test_grpc_protocol/test.py::test_session_settings 0.00s setup test_keeper_back_to_back/test.py::test_end_of_watches_session 0.00s setup test_mask_sensitive_info/test.py::test_on_cluster 0.00s teardown test_mask_sensitive_info/test.py::test_encryption_functions 0.00s teardown test_keeper_multinode_simple/test.py::test_follower_restart 0.00s setup test_grpc_protocol/test.py::test_simultaneous_queries_multiple_channels 0.00s setup test_jdbc_bridge/test.py::test_jdbc_distributed_query 0.00s setup test_keeper_back_to_back/test.py::test_sequential_nodes 0.00s setup test_ldap_external_user_directory/test.py::test_authentication_pass 0.00s teardown test_mask_sensitive_info/test.py::test_on_cluster 0.00s setup test_https_s3_table_function_with_http_proxy_no_tunneling/test.py::test_s3_with_https_remote_proxy 0.00s setup test_mask_sensitive_info/test.py::test_table_functions 0.00s setup test_keeper_back_to_back/test.py::test_end_of_session 0.00s teardown test_insert_into_distributed_sync_async/test.py::test_insertion_sync 0.00s setup test_ldap_external_user_directory/test.py::test_push_role_to_other_nodes 0.00s setup test_keeper_back_to_back/test.py::test_random_requests 0.00s setup test_keeper_multinode_simple/test.py::test_simple_replicated_table 0.00s setup test_grpc_protocol/test.py::test_session_temp_tables 0.00s setup test_insert_into_distributed_sync_async/test.py::test_insertion_sync_fails_with_timeout 0.00s setup test_insert_into_distributed_sync_async/test.py::test_insertion_without_sync_ignores_timeout 0.00s teardown test_mask_sensitive_info/test.py::test_create_database 0.00s teardown test_lazy_database/test.py::test_drop_table[0-s3-True-Log] 0.00s setup test_materialized_mysql_database/test.py::test_create_database_without_mysql_connection 0.00s setup test_jdbc_bridge/test.py::test_jdbc_query 0.00s teardown test_insert_into_distributed/test.py::test_prefer_localhost_replica 0.00s teardown test_ldap_external_user_directory/test.py::test_remote_query_user_does_not_exist_locally 0.00s setup test_insert_into_distributed/test.py::test_inserts_single_replica_local_internal_replication 0.00s teardown test_ldap_external_user_directory/test.py::test_authentication_pass 0.00s teardown test_insert_into_distributed/test.py::test_inserts_single_replica_internal_replication 0.00s teardown test_insert_into_distributed_sync_async/test.py::test_insertion_sync_with_disabled_timeout 0.00s teardown test_jdbc_bridge/test.py::test_jdbc_distributed_query 0.00s teardown test_jdbc_bridge/test.py::test_jdbc_insert =========================== short test summary info ============================ FAILED test_keeper_restore_from_snapshot/test.py::test_recover_from_snapshot PASSED test_grpc_protocol/test.py::test_output_format PASSED test_insert_into_distributed_sync_async/test.py::test_async_inserts_into_local_shard PASSED test_grpc_protocol/test.py::test_progress PASSED test_insert_into_distributed_sync_async/test.py::test_insertion_sync PASSED test_keeper_multinode_simple/test.py::test_follower_restart PASSED test_keeper_client/test.py::test_base_commands PASSED test_keeper_client/test.py::test_big_family PASSED test_keeper_multinode_simple/test.py::test_read_write_multinode PASSED test_keeper_client/test.py::test_delete_stale_backups PASSED test_insert_into_distributed_sync_async/test.py::test_insertion_sync_fails_with_timeout PASSED test_keeper_client/test.py::test_find_super_nodes PASSED test_keeper_client/test.py::test_four_letter_word_commands PASSED test_keeper_client/test.py::test_get_all_children_number PASSED test_keeper_client/test.py::test_quoted_argument_parsing PASSED test_keeper_client/test.py::test_rm_with_version PASSED test_keeper_client/test.py::test_rm_without_version PASSED test_keeper_client/test.py::test_set_with_version PASSED test_insert_into_distributed_sync_async/test.py::test_insertion_sync_with_disabled_timeout PASSED test_keeper_client/test.py::test_set_without_version PASSED test_keeper_multinode_simple/test.py::test_simple_replicated_table PASSED test_insert_into_distributed_sync_async/test.py::test_insertion_without_sync_ignores_timeout PASSED test_grpc_protocol/test.py::test_restart PASSED test_grpc_protocol/test.py::test_select_one PASSED test_grpc_protocol/test.py::test_session_settings PASSED test_grpc_protocol/test.py::test_session_temp_tables PASSED test_keeper_multinode_simple/test.py::test_watch_on_follower PASSED test_grpc_protocol/test.py::test_simultaneous_queries_multiple_channels PASSED test_jdbc_bridge/test.py::test_jdbc_delete PASSED test_jdbc_bridge/test.py::test_jdbc_distributed_query PASSED test_grpc_protocol/test.py::test_simultaneous_queries_same_channel PASSED test_grpc_protocol/test.py::test_totals_and_extremes PASSED test_jdbc_bridge/test.py::test_jdbc_insert PASSED test_grpc_protocol/test.py::test_transport_compression PASSED test_jdbc_bridge/test.py::test_jdbc_query PASSED test_jdbc_bridge/test.py::test_jdbc_table_engine PASSED test_jdbc_bridge/test.py::test_jdbc_update PASSED test_mask_sensitive_info/test.py::test_backup_table PASSED test_mask_sensitive_info/test.py::test_backup_to_s3 PASSED test_mask_sensitive_info/test.py::test_create_alter_user PASSED test_mask_sensitive_info/test.py::test_create_database PASSED test_mask_sensitive_info/test.py::test_create_dictionary PASSED test_keeper_back_to_back/test.py::test_concurrent_watches PASSED test_keeper_back_to_back/test.py::test_end_of_session PASSED test_keeper_back_to_back/test.py::test_end_of_watches_session PASSED test_keeper_back_to_back/test.py::test_multitransactions PASSED test_ldap_external_user_directory/test.py::test_authentication_fail PASSED test_ldap_external_user_directory/test.py::test_authentication_pass PASSED test_ldap_external_user_directory/test.py::test_push_role_to_other_nodes PASSED test_ldap_external_user_directory/test.py::test_remote_query_user_does_not_exist_locally PASSED test_ldap_external_user_directory/test.py::test_role_mapping PASSED test_mask_sensitive_info/test.py::test_create_table PASSED test_lazy_database/test.py::test_drop_table[0-default-False-Log] PASSED test_lazy_database/test.py::test_drop_table[0-s3-True-Log] PASSED test_mask_sensitive_info/test.py::test_encryption_functions PASSED test_mask_sensitive_info/test.py::test_on_cluster PASSED test_lazy_database/test.py::test_drop_table[4-default-False-Log] PASSED test_mask_sensitive_info/test.py::test_table_function_ways_to_call PASSED test_join_set_family_s3/test.py::test_join_s3 PASSED test_lazy_database/test.py::test_drop_table[4-s3-True-Log] PASSED test_join_set_family_s3/test.py::test_set_s3 PASSED test_insert_into_distributed/test.py::test_inserts_local PASSED test_insert_into_distributed/test.py::test_inserts_low_cardinality PASSED test_insert_into_distributed/test.py::test_inserts_single_replica_internal_replication PASSED test_insert_into_distributed/test.py::test_inserts_single_replica_local_internal_replication PASSED test_insert_into_distributed/test.py::test_inserts_single_replica_no_internal_replication PASSED test_intersecting_parts/test.py::test_intersect_parts_when_restart PASSED test_insert_into_distributed/test.py::test_prefer_localhost_replica PASSED test_insert_into_distributed/test.py::test_table_function PASSED test_https_s3_table_function_with_http_proxy_no_tunneling/test.py::test_s3_with_https_env_proxy PASSED test_https_s3_table_function_with_http_proxy_no_tunneling/test.py::test_s3_with_https_proxy_list PASSED test_mask_sensitive_info/test.py::test_table_functions PASSED test_https_s3_table_function_with_http_proxy_no_tunneling/test.py::test_s3_with_https_remote_proxy PASSED test_keeper_nodes_add/test.py::test_nodes_add PASSED test_log_levels_update/test.py::test_log_levels_update PASSED test_interserver_dns_retires/test.py::test_query PASSED test_keeper_broken_logs/test.py::test_single_node_broken_log PASSED test_keeper_reconfig_remove_many/test.py::test_reconfig_remove_2_and_leader PASSED test_keeper_back_to_back/test.py::test_random_requests PASSED test_keeper_back_to_back/test.py::test_sequential_nodes PASSED test_keeper_back_to_back/test.py::test_simple_commands PASSED test_keeper_back_to_back/test.py::test_stats PASSED test_keeper_back_to_back/test.py::test_watchers PASSED test_kafka_bad_messages/test.py::test_bad_messages_parsing_exception PASSED test_logs_level/test.py::test_check_client_logs_level PASSED test_keeper_persistent_log_multinode/test.py::test_restart_multinode PASSED test_keeper_reconfig_replace_leader_in_one_command/test.py::test_reconfig_replace_leader_in_one_command PASSED test_keeper_three_nodes_start/test.py::test_smoke PASSED test_materialized_mysql_database/test.py::test_binlog_client PASSED test_keeper_reconfig_remove/test.py::test_reconfig_remove_followers_from_3 PASSED test_materialized_mysql_database/test.py::test_clickhouse_killed_while_insert_5_7 PASSED test_materialized_mysql_database/test.py::test_clickhouse_killed_while_insert_8_0 PASSED test_keeper_snapshot_on_exit/test.py::test_snapshot_on_exit PASSED test_materialized_mysql_database/test.py::test_create_database_without_mysql_connection PASSED test_materialized_mysql_database/test.py::test_create_table_as_select PASSED test_materialized_mysql_database/test.py::test_default_values PASSED test_keeper_memory_soft_limit/test.py::test_soft_limit_create PASSED test_kafka_bad_messages/test.py::test_bad_messages_parsing_stream PASSED test_kafka_bad_messages/test.py::test_bad_messages_to_mv PASSED test_lost_part_during_startup/test.py::test_lost_part_during_startup =================== 1 failed, 99 passed in 734.59s (0:12:14) =================== Traceback (most recent call last): File "/home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration/./runner", line 445, in subprocess.check_call(cmd, shell=True) File "/usr/lib/python3.10/subprocess.py", line 369, in check_call raise CalledProcessError(retcode, cmd) subprocess.CalledProcessError: Command 'docker run --rm --name clickhouse_integration_tests_vtfnbd --privileged --dns-search='.' --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-odbc-bridge:/clickhouse-odbc-bridge --volume=/home/ubuntu/_work/_temp/test/build/clickhouse:/clickhouse --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-library-bridge:/clickhouse-library-bridge --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/programs/server:/clickhouse-config --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration:/ClickHouse/tests/integration --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/backupview:/ClickHouse/utils/backupview --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/grpc-client/pb2:/ClickHouse/utils/grpc-client/pb2 --volume=/run:/run/host:ro --volume=clickhouse_integration_tests_volume:/var/lib/docker -e DOCKER_DOTNET_CLIENT_TAG=11de0b29a15d -e DOCKER_HELPER_TAG=2cffe1eae894 -e DOCKER_BASE_TAG=1e0b53d756cf -e DOCKER_KERBEROS_KDC_TAG=9391ecdee8d7 -e DOCKER_MYSQL_GOLANG_CLIENT_TAG=9bec2a638e6e -e DOCKER_MYSQL_JAVA_CLIENT_TAG=766bff31cfe4 -e DOCKER_MYSQL_JS_CLIENT_TAG=41ba7c2ec2a1 -e DOCKER_MYSQL_PHP_CLIENT_TAG=88be89c1e3b6 -e DOCKER_NGINX_DAV_TAG=b55ac9cd7519 -e DOCKER_POSTGRESQL_JAVA_CLIENT_TAG=a4eff5c7f4d6 -e DOCKER_PYTHON_BOTTLE_TAG=caad4729259e -e DOCKER_CLIENT_TIMEOUT=300 -e COMPOSE_HTTP_TIMEOUT=600 -e PYTHONUNBUFFERED=1 -e PYTEST_ADDOPTS="--dist=loadfile -n 10 -rfEps --run-id=0 --color=no --durations=0 test_grpc_protocol/test.py::test_output_format test_grpc_protocol/test.py::test_progress test_grpc_protocol/test.py::test_restart test_grpc_protocol/test.py::test_select_one test_grpc_protocol/test.py::test_session_settings test_grpc_protocol/test.py::test_session_temp_tables test_grpc_protocol/test.py::test_simultaneous_queries_multiple_channels test_grpc_protocol/test.py::test_simultaneous_queries_same_channel test_grpc_protocol/test.py::test_totals_and_extremes test_grpc_protocol/test.py::test_transport_compression test_https_s3_table_function_with_http_proxy_no_tunneling/test.py::test_s3_with_https_env_proxy test_https_s3_table_function_with_http_proxy_no_tunneling/test.py::test_s3_with_https_proxy_list test_https_s3_table_function_with_http_proxy_no_tunneling/test.py::test_s3_with_https_remote_proxy test_insert_into_distributed/test.py::test_inserts_local test_insert_into_distributed/test.py::test_inserts_low_cardinality test_insert_into_distributed/test.py::test_inserts_single_replica_internal_replication test_insert_into_distributed/test.py::test_inserts_single_replica_local_internal_replication test_insert_into_distributed/test.py::test_inserts_single_replica_no_internal_replication test_insert_into_distributed/test.py::test_prefer_localhost_replica test_insert_into_distributed/test.py::test_table_function test_insert_into_distributed_sync_async/test.py::test_async_inserts_into_local_shard test_insert_into_distributed_sync_async/test.py::test_insertion_sync test_insert_into_distributed_sync_async/test.py::test_insertion_sync_fails_with_timeout test_insert_into_distributed_sync_async/test.py::test_insertion_sync_with_disabled_timeout test_insert_into_distributed_sync_async/test.py::test_insertion_without_sync_ignores_timeout test_intersecting_parts/test.py::test_intersect_parts_when_restart test_interserver_dns_retires/test.py::test_query test_jdbc_bridge/test.py::test_jdbc_delete test_jdbc_bridge/test.py::test_jdbc_distributed_query test_jdbc_bridge/test.py::test_jdbc_insert test_jdbc_bridge/test.py::test_jdbc_query test_jdbc_bridge/test.py::test_jdbc_table_engine test_jdbc_bridge/test.py::test_jdbc_update test_join_set_family_s3/test.py::test_join_s3 test_join_set_family_s3/test.py::test_set_s3 test_kafka_bad_messages/test.py::test_bad_messages_parsing_exception test_kafka_bad_messages/test.py::test_bad_messages_parsing_stream test_kafka_bad_messages/test.py::test_bad_messages_to_mv test_keeper_back_to_back/test.py::test_concurrent_watches test_keeper_back_to_back/test.py::test_end_of_session test_keeper_back_to_back/test.py::test_end_of_watches_session test_keeper_back_to_back/test.py::test_multitransactions test_keeper_back_to_back/test.py::test_random_requests test_keeper_back_to_back/test.py::test_sequential_nodes test_keeper_back_to_back/test.py::test_simple_commands test_keeper_back_to_back/test.py::test_stats test_keeper_back_to_back/test.py::test_watchers test_keeper_broken_logs/test.py::test_single_node_broken_log test_keeper_client/test.py::test_base_commands test_keeper_client/test.py::test_big_family test_keeper_client/test.py::test_delete_stale_backups test_keeper_client/test.py::test_find_super_nodes test_keeper_client/test.py::test_four_letter_word_commands test_keeper_client/test.py::test_get_all_children_number test_keeper_client/test.py::test_quoted_argument_parsing test_keeper_client/test.py::test_rm_with_version test_keeper_client/test.py::test_rm_without_version test_keeper_client/test.py::test_set_with_version test_keeper_client/test.py::test_set_without_version test_keeper_memory_soft_limit/test.py::test_soft_limit_create test_keeper_multinode_simple/test.py::test_follower_restart test_keeper_multinode_simple/test.py::test_read_write_multinode test_keeper_multinode_simple/test.py::test_simple_replicated_table test_keeper_multinode_simple/test.py::test_watch_on_follower test_keeper_nodes_add/test.py::test_nodes_add test_keeper_persistent_log_multinode/test.py::test_restart_multinode test_keeper_reconfig_remove/test.py::test_reconfig_remove_followers_from_3 test_keeper_reconfig_remove_many/test.py::test_reconfig_remove_2_and_leader test_keeper_reconfig_replace_leader_in_one_command/test.py::test_reconfig_replace_leader_in_one_command test_keeper_restore_from_snapshot/test.py::test_recover_from_snapshot test_keeper_snapshot_on_exit/test.py::test_snapshot_on_exit test_keeper_three_nodes_start/test.py::test_smoke 'test_lazy_database/test.py::test_drop_table[0-default-False-Log]' 'test_lazy_database/test.py::test_drop_table[0-s3-True-Log]' 'test_lazy_database/test.py::test_drop_table[4-default-False-Log]' 'test_lazy_database/test.py::test_drop_table[4-s3-True-Log]' test_ldap_external_user_directory/test.py::test_authentication_fail test_ldap_external_user_directory/test.py::test_authentication_pass test_ldap_external_user_directory/test.py::test_push_role_to_other_nodes test_ldap_external_user_directory/test.py::test_remote_query_user_does_not_exist_locally test_ldap_external_user_directory/test.py::test_role_mapping test_log_levels_update/test.py::test_log_levels_update test_logs_level/test.py::test_check_client_logs_level test_lost_part_during_startup/test.py::test_lost_part_during_startup test_mask_sensitive_info/test.py::test_backup_table test_mask_sensitive_info/test.py::test_backup_to_s3 test_mask_sensitive_info/test.py::test_create_alter_user test_mask_sensitive_info/test.py::test_create_database test_mask_sensitive_info/test.py::test_create_dictionary test_mask_sensitive_info/test.py::test_create_table test_mask_sensitive_info/test.py::test_encryption_functions test_mask_sensitive_info/test.py::test_on_cluster test_mask_sensitive_info/test.py::test_table_function_ways_to_call test_mask_sensitive_info/test.py::test_table_functions test_materialized_mysql_database/test.py::test_binlog_client test_materialized_mysql_database/test.py::test_clickhouse_killed_while_insert_5_7 test_materialized_mysql_database/test.py::test_clickhouse_killed_while_insert_8_0 test_materialized_mysql_database/test.py::test_create_database_without_mysql_connection test_materialized_mysql_database/test.py::test_create_table_as_select test_materialized_mysql_database/test.py::test_default_values -vvv" altinityinfra/integration-tests-runner:37a9815fd2fa ' returned non-zero exit status 1.